Data Engineer – Pipelines and Platform
Company: Parts Town
Category: IT
Addison
Type: Full Time
Parts Town is looking for a Data Engineer- Pipelines & Platform that will focus on building and maintaining reliable, scalable pipelines on their Google Cloud Platform (GCP) data ecosystem. They will ensure data from SAP, Salesforce, eCommerce, WMS, and other systems flows seamlessly into BigQuery through automated, monitored, and secure processes. You will play a pivotal and foundational role in shaping data driven and AI mission by building the pipelines, products, and platforms that power the next generation of digital distribution.
Salary range for this role is $118,679.40 – $137,799.97 salary which is based on including but not limited to qualifications, experience, and geographical location. Comprehensive benefits package includes health, dental and vision insurance, 401(k) with match, employee assistance programs, paid time off, paid sick time off, paid holidays, paid parental leave, and professional development opportunities.
Responsibilities:
- Design, build, and maintain ETL/ELT pipelines on GCP using Dataflow, Dataproc, or Cloud Data Fusion.
- Manage workflow orchestration with Cloud Composer (Airflow) for scheduling, retries, and monitoring.
- Optimize data ingestion from SAP, Salesforce, eCommerce, and WMS into BigQuery.
- Implement Pub/Sub streaming pipelines for near real-time use cases.
- Develop and manage bronze/silver layers (raw + cleansed) with best practices for schema design and partitioning.
- Implement data quality frameworks (Great Expectations, dbt tests, or custom Python checks) with automated alerts.
- Automate CI/CD for data pipelines using Cloud Build or GitHub Actions.
- Monitor cost/performance of pipelines with Cloud Monitoring & Logging.
- Document pipeline architecture and maintain data lineage via Dataplex or Collibra integration.



