Modern data platforms live or die by how quickly you can ship code to production.For one of our recent projects, that speed was determined by something deceptively simple: adding a custom Python module to our distributed jobs. We started on AWS EMR Serverless and later moved to Azure Databricks for compute jobs.Both platforms can absolutely run serious Spark workloads—but the experience of customizing the runtime for a small Python dependency could not have been more different. In this post,...

Docker containers have become the backbone of modern application deployment, but with widespread adoption comes increased security scrutiny. Organizations face mounting pressure to secure their software supply chain, especially when using open-source container images that may contain packages with known Common Vulnerabilities and Exposures (CVEs). In December 2025, Docker made a groundbreaking move by releasing over 1,000 hardened container images completely free under the Apache 2.0...