data-engineering

Learn the techniques we used to build a performant and efficient product categorization endpoint that will be used within our product data pipeline. Link

This article proposes an elegant way to build generator pipelines Link

Definitive tutorial for advanced use of MLflow Link

Hype wave, pragmatic evidence vs the need to move fast Link

An Introduction to the PyGWalker Library for Easy Data Visualisation Link

An architectural pattern is a general, reusable solution to a commonly occurring problem in software architecture within a given context. Architectural patterns are similar to software design pattern but have a broader scope. Link

In software engineering, a design pattern is a general repeatable solution to a commonly occurring problem in software design. A design pattern isn’t a finished design that can be transformed directly into code. It is a description or template for how to solve a problem that can be used in many different situations. Link

Figuring out how to implement your ML project? Learn how other organizations did it Link

In this blog post I summarize 4 existing architectural blueprints, and present a new one that, in my opinion, encompasses all the previous ones. Link

Server-sent events (SSE) is a way to send data to the browser without reloading the page. This allows you to use streaming data and build real-time applications that can be used in a variety of scenarios. Link

LMOps is a research initiative on fundamental research and technology for building AI products w/ foundation models, especially on the general technology for enabling AI capabilities w/ LLMs and Generative AI models. Link

Industrialization of Data Consumption by ML systems during both experimentation (historical batch) and production (batch & stream) — grow above & beyond toy-ML-with-csv and single-threaded-pickle-flasked-deployment. [Link]{https://medium.com/@sunil_iitb/ml-systems-industrialization-and-mlops-b30106974454}

System design is a very broad topic. Even a software engineer with many years of working experience at a top IT company may not be an expert on system design. If you want to become an expert, you need to read many books, articles, and solve real large scale system design problems. Link

It has been less than 18 months since we published our last MAD landscape, and it has been full of drama. Link

Learning to become a Smart Contract and Blockchain Developer can seem like a daunting task, but it doesn’t have to be! Link