https://w3shubh.com/tags/pyspark/Recent content in PySpark on Shubham | Full Stack & AI EngineerHugoenTue, 15 Apr 2025 00:00:00 +0530https://w3shubh.com/posts/pandora/Tue, 15 Apr 2025 00:00:00 +0530https://w3shubh.com/posts/pandora/A 4.5-year journey scaling frontend architectures, merging acquisitions, building big data pipelines, and shipping Generative AI infrastructure.https://w3shubh.com/posts/big-data-pipelines/Sun, 01 Oct 2023 00:00:00 +0530https://w3shubh.com/posts/big-data-pipelines/Owned critical big data infrastructure handling millions of signals daily. Optimized a core PySpark DAG saving 45 mins/day and retired legacy systems to save $130K annually.