Atlassian recently introduced Lithium, an in-house ETL platform designed to meet the requirements of dynamic data movement. Lithium streamlines tasks such as cloud migrations, scheduled backups, and in-flight data validations by supporting ephemeral pipelines and tenant-level isolation while ensuring efficiency and scalability, resulting in significant cost savings. Read more on InfoQ
Netflix engineers recently published a deep dive into their Distributed Counter Abstraction, a scalable service designed to track user interactions, feature usage, and business performance metrics with low latency globally. Built atop Netflix’s TimeSeries Abstraction, the system balances performance, accuracy, and cost through configurable counting modes, resilient data aggregation, and a globally distributed architecture. Read…
Agoda recently described their unconventional approach to transitioning from a monolithic GraphQL API to a microservices architecture. Unlike traditional methods focusing on breaking down server-side components first, Agoda adopted a client-first strategy, preparing their client applications to handle both the monolith and the microservices in parallel using an in-house smart orchestrator library. Read more on…
Uber recently detailed how it built Genie, an AI-powered on-call copilot designed to improve the efficiency of on-call support engineers. Genie leverages Retrieval-Augmented Generation (RAG) to provide accurate real-time responses and significantly enhance the speed and effectiveness of incident response. Read more on InfoQ
Canva recently shared how it implemented real-time mouse pointers for collaborative whiteboarding. Canva chose a WebRTC-based solution to improve scalability, reduce latency, and lower backend load. Since WebRTC uses peer-to-peer communication, Canva can provide users with a smoother, more performant real-time experience than a traditional backend-based WebSocket and Redis solution. Read more on InfoQ
Lyft recently published how it built the Glow emblem, its newest Internet-of-Things (IoT) device. The Glow is actively rolling out in markets across the US, with over 30,000 live devices. Its architecture addresses many challenges in previous iterations, including a unified IoT middleware framework, robust provisioning and authentication mechanisms and advanced device control. Read more on…
Raphaël Tahar, staff engineer at Decathlon, recently published his insights from co-leading an architecture process at scale. In a 4-part blog post series, Tahar depicts how, by combining methodologies like architecture committees, the C4 model, and System Thinking and emphasizing the importance of ADRs and centralized documentation, Decathlon ensures its teams are well-equipped to make informed,…
Slack’s engineering team recently published how it used a large language model (LLM) to automatically convert 15,000 unit and integration tests from Enzyme to React Testing Library (RTL). By combining Abstract Syntax Tree (AST) transformations and AI-powered automation, Slack’s innovative approach resulted in an 80% conversion success rate, significantly reducing the manual effort required and showcasing the potential of AI…
Recently, Microsoft engineers officially unveiled TypeSpec, a new language tailored for API-centric development that addresses the complex needs of modern API design. TypeSpec is an open-source, extensible language inspired by TypeScript and C#. It supports various protocols and serialization formats, enabling developers to use a single tool to manage multiple API specifications. Read more on InfoQ
Netflix engineers recently published how they use Elasticsearch Percolate Queries to “reverse search” entities in a connected graph. Reverse search means that instead of searching for documents that match a query, they search for queries that match a document, powering dynamic subscription scenarios where there is no direct association between the subscriber and the subscribed…
Netflix recently published how its Machine Learning Platform (MLP) team provides an ecosystem around Metaflow, an open-source machine learning infrastructure framework. By creating various integrations for Metaflow, Netflix is able to support hundreds of Metaflow projects maintained by multiple engineering teams. Read more on InfoQ
Uber developed an innovative caching solution, CacheFront, for its in-house distributed database, Docstore. CacheFront enables over 40M reads per second from online storage and achieves substantial performance improvements, including a 75% reduction in P75 latency and over 67% reduction in P99.9 latency, demonstrating its effectiveness in enhancing system efficiency and scalability. Read more on InfoQ