Data Ecosystem Data Engineer SME - Hybrid

Iron EagleX (IEX), a wholly owned subsidiary of General Dynamics Information Technology, delivers agile IT and Intelligence solutions. Combining small-team flexibility with global scale, IEX leverages emerging technologies to provide innovative, user-focused solutions that empower organizations and end users to operate smarter, faster, and more securely in dynamic environments

Job Description:

We are seeking a Data Ecosystem Data Engineer SME - Hybrid to design, build, and maintain data collection, processing, and integration pipelines that centralize and structure data from various web-based applications. You will work closely with software developers, data analysts, and product teams to ensure seamless data flow, high-quality data storage, and efficient retrieval methods. This role is ideal for someone passionate about data-driven decision-making and optimizing data aggregation processes while exploring and identifying right-sized technologies and computing resources.

This is not a Data Science, Big Data, ML-Ops, or AI-related role. Instead, this position focuses on wrangling disparate data sources into unified, consumable data APIs for internal and external stakeholders. This is a Hybrid position in Crystal City, VA (3 days onsite, 2 remote).

Job Duties Include (but not limited to):

Design, develop, and maintain data ingestion pipelines to collect structured and unstructured data from user applications and bulk data sources.
• Implement efficient data transformation and storage strategies to facilitate easy retrieval and analysis.
• Collaborate with software development teams to optimize application-generated data for streamlined aggregation.
• Ensure data integrity, security, and compliance with industry regulations and company policies.
• Optimize query performance and improve data access patterns to support analytical and operational use cases.
• Work with business stakeholders to define data requirements and improve data accessibility for decision-making.
• Design and build APIs to support data ingestion, retrieval, and integration with external systems.
• Develop and maintain event-driven architectures, utilizing event storage for real-time data processing.

Required Skills & Experience:

• 10+ years of experience in data engineering, software development, or a related role.
• Proficiency in database technologies, including SQL, NoSQL, and event-based databases (e.g., PostgreSQL, MySQL, MongoDB, EventStoreDB).
• Strong programming skills in Golang, Python, and JavaScript/TypeScript.
• Experience with cloud-based data solutions (AWS, GCP, or Azure) and data warehousing.
• Experience working with AWS S3 for scalable storage solutions and OpenSearch for search functionality.
• Proficiency in developing and managing APIs using FastAPI.
• Experience using Trino for query optimization and distributed SQL processing.
• Proficiency in working with Parquet Files for efficient data storage and retrieval.
• Hands-on experience with Airflow for orchestrating complex data workflows.
• Familiarity with Databricks Medallion model.
• Familiarity with OpenMetaData for metadata management and data governance.
• Experience working with streaming and batch data processing frameworks is a plus.
• Due to US Government Contract Requirements, only US Citizens are eligible for this role.

Security Clearance:

• An active TS/SCI security clearance is REQUIRED

Equal Opportunity Employer / Individuals with Disabilities / Protected Veterans