Back to All Positions
Senior Data Engineer – GCP
Data & AIRemoteFull-timeID: REQ-1001
N2P Systems
Denver, CO, USA5-8 years$0 - $0 USDPosted 2 weeks ago
Role Overview
## Role Overview
We are seeking a Senior Data Engineer with strong hands-on expertise in Google Cloud Platform (GCP) and Java-based Cloud Dataflow development. The role focuses on building high-performance batch and streaming data pipelines using Apache Beam with Java, while developing scalable enterprise data platforms and reliable ETL/ELT solutions on GCP.
The engineer will work extensively with Dataflow, BigQuery, Google Cloud Storage, Cloud Composer, and modern data architecture patterns, including Medallion Architecture. The role also requires a strong focus on data processing performance, scalability, cost optimization, security, and operational reliability.
## Key Responsibilities
- Design, develop, and maintain scalable batch and streaming data pipelines using Google Cloud Dataflow and Apache Beam with Java.
- Build reusable, high-performance Java-based data processing frameworks.
- Develop enterprise-grade ETL/ELT pipelines on GCP.
- Design and implement Medallion Architecture across Bronze, Silver, and Gold data layers.
- Develop and optimize analytical datasets in BigQuery.
- Write efficient SQL and optimize query performance for large-scale datasets.
- Orchestrate data workflows using Cloud Composer and Apache Airflow.
- Manage data storage and lifecycle using Google Cloud Storage.
- Implement CI/CD pipelines using Git and modern DevOps practices.
- Apply GCP IAM best practices for security, access control, and governance.
- Monitor, troubleshoot, and optimize Dataflow jobs for performance, scalability, reliability, and cost efficiency.
## Project Goals
- Build scalable and reliable batch and streaming data pipelines on GCP.
- Establish modern Medallion-based data lake architecture for enterprise analytics.
- Improve data processing performance and cost efficiency across large-scale workloads.
- Deliver maintainable, secure, and production-ready ETL/ELT infrastructure.
Key Responsibilities
- Design, develop, and maintain scalable batch and streaming data pipelines using Google Cloud Dataflow and Apache Beam with Java.
- Build reusable, high-performance Java-based data processing frameworks.
- Develop enterprise-grade ETL/ELT pipelines on GCP.
- Design and implement Medallion Architecture across Bronze, Silver, and Gold data layers.
- Develop and optimize analytical datasets in BigQuery.
- Write efficient SQL and optimize query performance for large-scale datasets.
- Orchestrate data workflows using Cloud Composer and Apache Airflow.
- Manage data storage and lifecycle using Google Cloud Storage.
- Implement CI/CD pipelines using Git and modern DevOps practices.
- Apply GCP IAM best practices for security, access control, and governance.
- Monitor, troubleshoot, and optimize Dataflow jobs for performance, scalability, reliability, and cost efficiency.
- ## Project Goals
- Build scalable and reliable batch and streaming data pipelines on GCP.
- Establish modern Medallion-based data lake architecture for enterprise analytics.
- Improve data processing performance and cost efficiency across large-scale workloads.
- Deliver maintainable, secure, and production-ready ETL/ELT infrastructure.
Required Skills & Qualifications
- Strong proficiency and experience with Java
- Strong proficiency and experience with Google Cloud Dataflow
- Strong proficiency and experience with Apache Beam
- Strong proficiency and experience with Google Cloud Platform
- Strong proficiency and experience with BigQuery
- Strong proficiency and experience with ETL/ELT
- Strong proficiency and experience with Advanced SQL
- Strong proficiency and experience with Medallion Architecture
- Strong proficiency and experience with Google Cloud Storage
- Strong proficiency and experience with Cloud Composer
- Strong proficiency and experience with CI/CD and Git
- Strong proficiency and experience with GCP IAM and Cloud Security
- Strong proficiency and experience with Google Cloud Platform (GCP)
- Strong proficiency and experience with Apache Beam SDK
- Strong proficiency and experience with Enterprise ETL/ELT Pipelines
- Strong proficiency and experience with SQL Query Optimization
- Strong proficiency and experience with Google Cloud Storage (GCS)
- Strong proficiency and experience with Apache Airflow
- Strong proficiency and experience with CI/CD
- Strong proficiency and experience with Git
- Strong proficiency and experience with GCP IAM
- Strong proficiency and experience with Cloud Security
Target Tech Stack
JavaGoogle Cloud DataflowApache BeamGoogle Cloud PlatformBigQueryETL/ELTAdvanced SQLMedallion ArchitectureGoogle Cloud StorageCloud ComposerCI/CD and GitGCP IAM and Cloud SecurityGoogle Cloud Platform (GCP)Apache Beam SDKGoogle Cloud Storage (GCS)Apache AirflowSQLETLELTData Lake ArchitectureBatch Data ProcessingStreaming Data ProcessingCI/CDGitGCP IAMCloud SecurityDataflow Performance OptimizationData Pipeline DevelopmentData ArchitectureEnterprise ETL/ELT PipelinesSQL Query Optimization
Quick Details
- Location
- Denver, CO, USA
- Employment Type
- Full-time
- Work Arrangement
- Remote
- Experience Level
- 5-8 years
- Compensation
- $0 - $0 USD
- Domain Focus
- Data & AI
- Requisition Ref
- REQ-1001
Ready to Apply?
Submit your resume and contact information. Our recruitment lead for this role will review your dossier and connect with you.
Apply for this Role