Develop and maintain automated data collection systems, written in Scala, for grocery-related datasets
Maintain Airflow DAGs written in Python
Reverse engineer web APIs and integrate them into a unified data pipeline
Design and implement evasion techniques to ensure high data acquisition success rates
Collaborate with Product and Customer teams to transform raw data into actionable insights
Projects
Led development of a Playwright-based browser automation framework, simplifying integration logic and supporting advanced features such as JavaScript rendering, API encryption handling, and dynamic login workflows
Initiated effort to define and standardize the 'Out-of-Stock' detection logic, collaborating with cross-functional teams to align on data parsing patterns. Improved understanding, and clarity into data meaning.
Hyperfiddle
Remote
Software Engineer
March 2020 - September 2020
Responsibilities
Built full-stack features in a Clojure/ClojureScript + Datomic application framework
Implemented CI/CD pipeline using CircleCI, AWS ECR/ECS, and Terraform
Built configurable sample data generation library to support product demos and internal testing workflows
Projects
Designed an extensible algebra system for Datomic statements