Haystack: An Extensible Observability Platform From Expedia
Open Source For You|January 2019

Most companies usually run hundreds of microservices, but what happens when one or more services fail at the same time? To improve the observability and quality of service, we need to connect these failure points across the distributed topology to reduce the mean time to discover and resolve issues. To understand how Expedia implemented tracing and diagnostics by building a solution called Haystack, Ankita K.S. from the EFY Group had a chat with Shreya Sharma, technical product manager, and Keshav Peswani, software engineer, Expedia Inc., during Open Source India 2018. Excerpts follow…

Haystack: An Extensible Observability Platform From Expedia

Q How do you think open source software has developed in India over the past few years?

Around 1997 and 1998, Linux was the only key open source project available but with time, we saw bigger and better companies come up with a lot of open source technologies. For example, at Expedia, we use many of the open source technologies developed by various other companies, as we are in the building mode. India is currently at a great stage, not only as a contributor but also as a creator of open source software solutions. I personally see a very huge change. Several years ago, when I started working, there were hardly any open source contributors. But today, with many key open source players, the scenario has changed for the better.

Q What are the new technologies that have come up in the recent past and how will they impact the future?

Inventions yield yet more inventions. With the growth in the microservices architecture, the need arose for a centralised system for load balancing, traffic managing, routing, health monitoring, etc. This is where a service mesh comes into the picture. A service mesh is a new architectural paradigm to facilitate these services on a platform level and it frees the application writers from those tasks. Istio and Linkerd are the most popular ones.

We’ve also observed growth in container orchestration systems like Kubernetes, Mesos and Marathon, which handle the infrastructure layer in a more efficient manner.

Q What is the main problem with respect to microservices?

This story is from the January 2019 edition of Open Source For You.

Start your 7-day Magzter GOLD free trial to access thousands of curated premium stories, and 8,500+ magazines and newspapers.

This story is from the January 2019 edition of Open Source For You.

Start your 7-day Magzter GOLD free trial to access thousands of curated premium stories, and 8,500+ magazines and newspapers.

MORE STORIES FROM OPEN SOURCE FOR YOUView All
The Crucial Role of Open Source in Advancing Blockchain Technology
Open Source For You

The Crucial Role of Open Source in Advancing Blockchain Technology

Open source and blockchain technology are like soulmates, forging connections, building bridges, and working together to create a future that is more open, inclusive, and equitable.

time-read
10 mins  |
May 2024
Why Open Source Dependencies Must be Managed
Open Source For You

Why Open Source Dependencies Must be Managed

Unmanaged reliance on open source software may result in a Support crisis over a project’s life span, as well as financial loss for the organisation. Planned and regular upgrades of open source software components are a must.

time-read
6 mins  |
May 2024
Why Cloud Security Alone is Not Enough for Enterprises
Open Source For You

Why Cloud Security Alone is Not Enough for Enterprises

Traditional and off-the-shelf security tools for the cloud may lull organisations into a false sense of being safe from cyber threats. This first article in the two-part series explains why organisations must develop an enterprise cloud security governance strategy’.

time-read
6 mins  |
May 2024
Openchain: Revolutionising Supply Chain Management
Open Source For You

Openchain: Revolutionising Supply Chain Management

Openchain’s unique features cater specifically to enhancing supply chain management. This distributed ledger technology is helping to build a future where supply chains are more transparent, efficient, and secure.

time-read
2 mins  |
May 2024
Open Source, Private and Public Blockchain Platforms: What They Offer
Open Source For You

Open Source, Private and Public Blockchain Platforms: What They Offer

Open source platforms play a crucial role in driving innovation and democratising access to blockchain technology. These platforms promise to have a significant impact on the future of society by offering a range of benefits.

time-read
7 mins  |
May 2024
Why Choose Hyperledger Sawtooth?
Open Source For You

Why Choose Hyperledger Sawtooth?

Hyperledger Sawtooth has earned a formidable reputation as a champion of modularity in the realm of enterprise blockchains. We delve into its components and functionalities, as well as the advantages it offers businesses seeking custom-crafted blockchain solutions.

time-read
8 mins  |
May 2024
Hyperledger Fabric: What You Should Know and Why
Open Source For You

Hyperledger Fabric: What You Should Know and Why

Understanding the essential features of Hyperledger Fabric is crucial for anyone looking to develop blockchain applications for enterprise use. These features provide the foundation for building secure, scalable, and privacy-focused applications, and can be leveraged to create innovative solutions that address real-world business challenges.

time-read
7 mins  |
May 2024
The Metaverse and Blockchain Technology: What the Future Holds
Open Source For You

The Metaverse and Blockchain Technology: What the Future Holds

The integration of the metaverse with blockchain technology has opened exciting possibilities for managing digital assets in virtual environments. As virtual worlds become increasingly immersive and interconnected, the need for secure and efficient asset management solutions has never been greater.

time-read
7 mins  |
May 2024
Machine Learning Basics for a Newbie
Open Source For You

Machine Learning Basics for a Newbie

Machine learning is a vast and rapidly evolving field, and this article serves as a stepping stone for those new to the domain. Explore the fundamental concepts of machine learning, from understanding the differences between traditional programming and ML to delving into various types of machine learning algorithms.

time-read
7 mins  |
May 2024
Human-AI Collaboration is the Future
Open Source For You

Human-AI Collaboration is the Future

Al-augmented decision making is making a transformative impact across various fields, benefiting a range of industries.

time-read
8 mins  |
May 2024