Since December 2020, AWS Lambda supports Docker containers as a runtime environment for serverless functions. We show how to use it to package Python code with all its dependencies.

Data projects require a different skill set than software engineering projects

How to make Business Intelligence future-proof by applying software engineering principles

TaskFlow API is a feature that promises data sharing functionality and a simple interface for building data pipelines in Apache Airflow 2.0. It should allow the end-users to write Python code rather than Airflow code.

Observabilit has gained a lot of popularity in recent years. To assess the health of IT systems, engineering teams typically use logs, metrics, and traces, which are used by various developer tools to facilitate observability.