DataOps Engineer

Back to Jobs
Woongjin Energy logo

DataOps Engineer

Woongjin Energy

110,000–125,000 / Year

Location

Englewood Cliffs, NJ, United States

Experience

Mid

Posted

Jul 30, 2026

Apply by

August 29, 2026

Applicants

0

Early applicantEasy applyContractWork from Office

Job Description

## Company Description For More Open Positions Visit us at: http://recruiting.woongjininc.com/ Our Mission WOONGJIN, Inc. is a rapidly growing team who provides a range of unique, exceptional, and enhanced services to our clients. We have a strong moral code that includes the service of goodness without expectations of reward. We are motivated by the sense of responsibility and servant leadership. Benefits - Medical Insurance - Vision Insurance - Dental Insurance - 401(k) - Paid Sick hours ## Job Description We are looking for a mid‑level engineer to build and operate a data platform that uses Apache Iceberg as the lake‑house table format and Docker‑based micro‑services (Spark, Flink, Presto, etc.). you will own the end‑to‑end delivery pipeline, monitoring, security, and incident response, ensuring the platform runs reliably at scale. Key Responsibilities - Iceberg operations: support tables, manage schema changes, partitions, snapshot retention, and keep the catalog (Hive Metastore, AWS Glue, Nessie, …) synchronized. - Docker image creation & testing: write multi‑stage Dockerfiles for Spark/Flink/Presto, run local test environments with Docker‑Compose, and conduct vulnerability scans (Trivy, Snyk, …). - Data pipeline development: build ETL/ELT jobs that ingest raw data and write to Iceberg tables; add simple streaming components using Kafka, Pulsar, or Kinesis when needed. - CI/CD automation: configure pipelines (GitHub Actions, GitLab CI, Azure DevOps, …) to lint Dockerfiles, scan images, version Iceberg metadata, and deploy pipelines without downtime. - Automation with Ansible/Python: script cluster provisioning, catalog configuration, vacuum/compaction, and other routine housekeeping tasks. - Observability: instrument services with OpenTelemetry, Prometheus, Grafana, and Loki; create dashboards showing pipeline latency, resource usage, table health, and error rates; set up basic alerts. - SLA monitoring: measure data freshness, job success rates, and query response times against agreed‑upon targets and report deviations. - Incident response: join the on‑call rotation, perform first‑line diagnosis and resolution of pipeline failures, Iceberg metadata issues, or container crashes; write concise root‑cause analyses and suggest improvements. - Security & compliance support: help enforce image signing, mTLS, IAM roles, and bucket policies; collaborate with the security team to meet GDPR, HIPAA, or ISO 27001 requirements. - Knowledge sharing: keep internal documentation up to date and run short tech demos or brown‑bag sessions on Iceberg, Docker best practices, and automation techniques. ## Qualifications - Bachelor’s degree in Computer Science, IT, Data Engineering, or a related field (Master’s a plus). - 5+ years of hands‑on experience building and operating large‑scale data platforms (lake‑house, data‑warehouse, or big‑data ecosystems). - Proven production experience with Apache Iceberg (table creation, partition management, schema evolution, catalog integration). - Strong Docker skills: multi‑stage builds, Docker‑Compose testing, routine image security scanning. - Experience with at least one major data‑processing engine (Spark, Flink, or Presto/Trino) and its connection to Iceberg tables. - Proficiency in Python and/or Ansible for automating infrastructure and platform tasks. - Experience building CI/CD pipelines that include Docker linting, vulnerability scanning, and automated deployment of data‑pipeline code. - Familiarity with observability tooling (Prometheus, Grafana, OpenTelemetry, Loki) and ability to create useful alerts and dashboards. - Ability to respond to incidents, write clear root‑cause analysis reports, and contribute to post‑mortem actions. - Willingness to participate in an on‑call rotation as a first‑line responder. - Availability to work on‑site in New Jersey for the initial assignment and relocate to Dallas by October 2026. Preferred Qualifications - Experience with cloud‑native data services on AWS, Azure, or GCP (EMR, Dataproc, Synapse, etc.). - Familiarity with other lake‑house formats such as Delta Lake or Apache Hudi and ability to evaluate trade‑offs against Iceberg. - Knowledge of streaming platforms (Kafka, Pulsar, Kinesis) and real‑time processing patterns. - Relevant certifications (Databricks Lakehouse Associate, Google Professional Data Engineer, AWS Certified Data Analytics – Specialty, etc.). - Background supporting data platforms in regulated industries (pharma, finance, healthcare) and understanding of associated compliance frameworks. ## Additional Information All your information will be kept confidential according to EEO guidelines. \\\ NO C2C \\\

Key Responsibilities

  • Manage Apache Iceberg table operations including schema changes, partitions, and catalog synchronization.
  • Create and test multi-stage Docker images for Spark, Flink, and Presto using Docker-Compose.
  • Develop ETL/ELT jobs and streaming components using Kafka, Pulsar, or Kinesis.
  • Configure CI/CD pipelines for linting, vulnerability scanning, and automated deployment.
  • Script cluster provisioning and routine housekeeping tasks using Ansible and Python.
  • Instrument services with OpenTelemetry, Prometheus, Grafana, and Loki for observability.
  • Monitor SLAs for data freshness, job success rates, and query response times.
  • Participate in on-call rotation for incident response and root-cause analysis.
  • Enforce security best practices including image signing, mTLS, and IAM roles.
  • Maintain internal documentation and conduct tech demos on data platform best practices.

Requirements

  • Bachelor's degree in Computer Science
  • IT
  • Data Engineering
  • or a related field

Skills Required

Apache IcebergDockerSparkFlinkPrestoPythonAnsibleGitHub ActionsGitLab CIAzure DevOpsTrivySnykKafkaPulsarKinesisOpenTelemetryPrometheusGrafanaLokiHive MetastoreAWS GlueNessieIncident responseRoot-cause analysisKnowledge sharingCollaborationAWSAzureGCPEMRDataprocSynapseDelta LakeApache Hudi

Benefits

  • Medical Insurance
  • Vision Insurance
  • Dental Insurance
  • 401(k)
  • Paid Sick hours

App exclusive · Free

Smart Job AI Coach

Your personal interview coach on every job — readiness tips, profile improvements, and role-specific prep. Available only in the Pulse Job app.

Interview readiness

See how prepared you are and what to improve for each role.

Personalized tips

Actionable suggestions based on your profile and the job.

After you apply

Keep coaching momentum from job detail through application success.

Get Smart Job AI Coach in the appFree on iOS and Android