Automation Data Integration Engineer
@ UltraViolet CyberAutomation Data Integration Engineer
About the job
UltraViolet Cyber provides security operations solutions for Fortune 500, federal, and commercial clients. As an Automation Data Integration Engineer, you will enhance DHS's cybersecurity through automation, data pipelines, and system reliability in a dynamic environment.
Requirements
- 8+ years data integration experience
- Expertise in Apache Airflow or Prefect
- Proficiency in Python and SQL
- Experience with APIs and data warehouses
- U.S
Qualifications
- BS/BA degree or equivalent
- Knowledge of ETL/ELT processes
- Experience with automation tools
- Understanding of data quality frameworks
- Familiar with cloud platforms
Full job description
UltraViolet Cyber (UVC) is searching for an Automation Data Integration Engineer to support DHS in Washington, D.C. As an Automation Data Integration Engineer, you will play a crucial role in enhancing the efficiency and effectiveness of DHS's cybersecurity operations. You will work in a dynamic environment, collaborating with cybersecurity professionals, data analysts, and system owners to design and implement automated solutions that reduce manual effort and improve risk visibility. Your efforts will directly contribute to safeguarding DHS's mission-critical systems and data through advanced automation and integration. The Automation Data Integration Engineer will be responsible for maintaining cybersecurity automations, connectors, data pipelines, and dashboards that reduce manual effort and improve risk visibility across tools and workflows.
This position requires creating and managing end-to-end pipelines ingesting data from diverse sources (APIs, databases, IoT) and delivering data to data warehouses or lakes. The Automation Data Integration Engineer will automate extraction, transformation, and loading processes to ensure data is clean, standardized, and ready for analysis. This role is critical for implementing automated tests, anomaly detection, and real-time alerts to validate data integrity.
What You'll Do:
- Design and maintain cybersecurity automations, connectors, data pipelines, and dashboards that reduce manual effort and improve risk visibility across tools and workflows.
- Perform Data Pipeline Automation by creating and managing end-to-end pipelines that ingest data from diverse sources (APIs, databases, IoT) and deliver it to data warehouses or lakes.
- Perform ETL/ELT Optimization by automating the extraction, transformation, and loading process to ensure data is clean, standardized, and ready for analysis.
- Perform Data Quality & Observability by implementing automated tests, anomaly detection, and real-time alerts to validate data integrity and identify issues.
- Perform Workflow Orchestration by scheduling and managing dependencies for data jobs using tools like Apache Airflow or Prefect.
- Perform System Reliability & Maintenance by building self-healing pipelines that can automatically retry failed tasks and scale resources based on demand.
- Perform Data Cleansing & Validation by running automated scripts to detect data anomalies, impute missing values, or mask sensitive information.
- Perform CI/CD Integration by implementing continuous integration and deployment for data pipelines.
What You Have:
- DHS EOD suitability or Current DHS or DHS EOD preferred
- BS/BA + 8 years of applicable experience in data integration and automation
- Demonstrated expertise in Apache Airflow, Prefect, or similar orchestration tools
- Experience with ETL/ELT processes and automation tools
- Knowledge of data quality frameworks and observability systems
- Experience with APIs, databases, and data warehouse/lake technologies
- Strong programming skills in Python, SQL, or similar languages
- Experience with Infrastructure as Code (IaC) tools (Terraform, CloudFormation)
- Knowledge of data catalog and metadata management solutions
- Experience with CI/CD pipelines (Jenkins, GitLab, GitHub Actions)
- Familiarity with cloud platforms (AWS, Azure, GCP)
- Cloud security experience with AWS, Azure, or other platforms
What We Offer:
Similar jobs in Columbus, OH
- J
Controls Engineer - Industrial Automation
Jobot · Columbus, OH, United States
Posted 4 days ago - C
Automation/Controls Engineer
Continental · Marysville, OH, United States
Posted 1 week ago - J
Senior Healthcare Data Engineer
Jobot · Westerville, OH, United States
Posted 4 days ago - J
HVAC Controls Engineer – Building Automation
Jobot · Columbus, OH, United States
Posted 1 day ago - A
Senior Electrical Engineer, Data Centers - Remote (U.S.)
AECOM · Columbus, OH, United States
Posted 2 weeks ago - A
Senior Mechanical Engineer, Data Centers - Remote (U.S.)
AECOM · Columbus, OH, United States
Posted 2 weeks ago