Experiences
- Developed and maintained data pipelines in Azure Data Factory and Databricks
- Designed and optimized data models for analytics and reporting
- Built and maintained Tableau dashboards for operational insights
- Managed and updated SSIS packages in SQL Server
- Wrote and optimized stored procedures to improve database performance
- Helped tune and optimize performance of SQL Server data warehouse
- Assisted in migrating on-premises data infrastructure to the cloud
- Built custom data extractors using Python within the Singer.io framework
- Developed and deployed ETL pipelines using Meltano on AWS Elastic Container Service
- Implemented data extractions with AWS Lambda
- Designed and maintained data pipelines connecting the data warehouse to Salesforce and HubSpot
- Modeled and transformed data from multiple sources using dbt
- Partnered with data scientists to train machine learning models in AWS SageMaker
- Containerized and deployed machine learning models using Docker and AWS Elastic Container Service
- Provisioned and managed AWS infrastructure with Terraform
- Supervised and mentored a junior data engineer
- Worked closely with data analysts to support reporting and insights
- Administered and maintained Looker projects and dashboards
- Engaged with executives and stakeholders across departments to align data solutions with business needs
- Managed Snowflake data warehouse security, implementing role-based access controls to protect PII
- Developed data pipelines and transformations in Azure Data Factory and Databricks
- Built interactive dashboards in Power BI for business reporting
- Documented workflows, architecture, and best practices in Atlassian Confluence
- Tracked and managed tasks using Atlassian JIRA
- Implemented OIDC authentication in Django to enhance security and user management
- Contributed to backend and frontend development in Django, Flask, and React projects
- Monitored application health and performance using Sentry
- Managed infrastructure monitoring and alerts with AWS CloudWatch
- Built a rule engine to automatically tag and categorize orders
- Worked closely with stakeholders to define and implement new features
- Collaborated closely with stakeholders when implementing features
- Participated in architectural design decisions to improve system scalability and maintainability
- Documented workflows, technical designs, and best practices in Atlassian Confluence
- Tracked development tasks and project progress using Atlassian JIRA
- Maintained and optimized legacy batch processes for rendering map tiles in Azure
- Developed tooling in Python, C#, and PowerShell to improve batch process efficiency
- Built a Python application using NumPy to convert proprietary geospatial formats to open standards
- Created web scrapers with Selenium and Scrapy to automate geospatial data collection for analysts
- Documented applications and workflows to support maintainability and knowledge sharing
- Used R and Scala with Apache Spark to detect anomalies in financial data
- Built Spring Boot microservices to expose analytical data to other teams
- Developed R libraries to support data analysts in their workflows
- Created scrapers to extract data from PDF reports
- Contributed to Apache Airflow pipelines for orchestrating data flows
- Documented processes, tools, and workflows in Atlassian Confluence
- Managed development tasks and tracking in Atlassian JIRA
- Developed a web scraper to collect data from government websites
- Built an internal web mapping application using React, Leaflet, and Flask to assist property assessors
- Maintained and updated legacy reports using SAS
- Developed Python tooling to execute SAS programs on an IBM OS/360 mainframe via FTP
- Collaborated with stakeholders to design and refine database schemas
- Fulfilled ad hoc data requests from various departments
- Designed and maintained geospatial databases for real estate analysis
- Scraped retailer websites and third-party APIs using Scrapy to collect location and market data
- Stored and managed geospatial data in a PostGIS database
- Created marketing maps using Adobe Illustrator with Avenza and PostGIS
- Developed charts for marketing materials using Python, ggplot2, and matplotlib
- Built an internal web mapping application with Flask and jQuery to organize property listings
- Fulfilled ad hoc requests for maps and data analysis
- Collaborated with real estate brokers to support marketing strategies with geospatial insights