Never Call `spark.stop()` in Databricks Workflows
Never call spark.stop() in Databricks workflows. Explicitly call sys.exit().
Today I Learned
A collection of small learnings, discoveries, and insights I come across in my daily work and exploration. These are bite-sized pieces of knowledge that might be useful to others.
Building Personal AI Copilots
How treating your LLM Tools like humans can help you build personal AI copilots.
Mypy Narrowing of Union[T, None]
Mypy only narrows Union[T, None] when it sees an explicit check for None or an assertion. This behaviour leads to type errors that may seem unintuitive to solve.