data-engineering

Automate All the Boring Kubernetes Operations with Python

0
Kubernetes became a de-facto standard in recent years and many of us - both DevOps engineers and developers alike - use it on daily basis. Many of the task that we perform are however, same, boring and easy to automate. Oftentimes it’s simple enough to whip up a quick shell script with a bunch of kubectl commands, but for more complicated automation tasks bash just isn’t good enough, and you need the power of proper language, such as Python.

Data Memos

0
12 reflections on data (and its representation) that we don’t want to forget in the “next-normal” Link

Graph Neural Network for Recommender System

0
Recently, graph neural network (GNN) has become the new state-of-the-art approach in many recommendation problems, with its strong ability to handle structured data and to explore high-order information. However, as the recommendation tasks are diverse and various in the real world, it is quite challenging to design proper GNN methods for specific problems. In this tutorial, we focus on the critical challenges of GNN-based recommendation and the potential solutions. Link
Multi node PyTorch Distributed Training Guide For People In A Hurry

Multi node PyTorch Distributed Training Guide For People In A Hurry

0
PyTorch is designed to be the framework that’s both easy to use and delivers performance at scale. Indeed it has become the most popular deep learning framework, by a mile among the research community. However, despite some lengthy official tutorials and a few helpful community blogs, it is not always clear what exactly has to be done to make your PyTorch training to work across multiple nodes. Link