Data Engineer
Trinity Industries, Inc. is seeking a Data Engineer to join our Queretaro, Mexico Office!
The successful candidate will be part of our Dallas, TX Corporate Office Enterprise - Data Engineering team and will be responsible for data integration, data transformation, and developing data pipelines using parallel processing with cloud-based technologies.
What you’ll do:
- Build processes supporting query optimization, data transformation, data structures, metadata, dependency, and workload management
- Work with data scientists to facilitate technical design of complex data sourcing, transformation, and aggregation logic, ensuring business analytics requirements are met
- Work with big data pipelines to develop streaming analytics
- Utilize business intelligence data visualization tools and techniques to translate business analytics into solutions
- Engage regularly with management to prioritize business and information needs
What you’ll need:
- Bachelor's (preferably master’s in computer science, business analytics, mathematics, and/or quantitative fields) or equivalent with a minimum of 5 years of relevant experience
- Proficiency in programming languages relevant to data engineering, including Python, Java, or Scala
- Deep understanding of data modeling and data pipelines
- Experience with data storage and processing technologies (e.g., Hadoop, Spark, Kafka, SQL databases)
- Strong experience with cloud-based data solutions, especially AWS, Azure, and GCP
- Experience with API based data acquisition and management
- Familiarity with parallel processing, multithreading, and compute optimization
- Must be fully fluent in both English and Spanish/conversationally and written
- Databricks or Palantir Foundry AI/BI application development is a plus
- Background in leveraging semi-structured and unstructured data for NLP pipelines and image classification pipelines