Logo of Huzzle

Data Engineer

  • Job
    Full-time
    Mid Level
  • IT & Cybersecurity
  • Bangalore

AI generated summary

  • You need experience with relational/non-relational databases, ETL tools, Azure, data integration, T-SQL, and strong communication skills. Manufacturing and SAP knowledge are a plus.
  • You will build ETL pipelines, model databases, design integrations, collaborate with teams, perform data quality analysis, and provide production support while optimizing system performance.

Requirements

  • Familiarity with various relational and non-relational database management systems, in particular Microsoft classic and cloud ecosystem
  • Architectural understanding of data hub oriented integrations as single point of orchestration
  • Hands on knowledge in the design of data flows that facilitate data harvesting for automated genealogy documentation in a data catalog
  • Able to work in various delivery methodologies (Agile – Scrum/SAFe, Waterfall, Kanban, etc.)
  • Ability to read, interpret, analyze, and communicate effectively verbally and in written form
  • Familiarity with UML Sequence diagrams
  • Knowledge of data integration patterns across various functions of the enterprise
  • Experience with cloud-based solutions preferably on Microsoft stack
  • Azure Synapse
  • Data Factory
  • Data Lake
  • Experience implementing and supporting scalable solutions, with a solid understanding of database locking escalation and other concurrency related mechanisms
  • Understanding of when and how to use table partitioning and other data insertion, storage and distribution approaches
  • Bachelor’s in Information Technology or a related field (experience will be considered in lieu of education requirement)
  • 3+ years of
  • ETL development experience with T-SQL, Talend or other graphical ETL tools (Datastage, SSIS, Informatica, Ab Initio, PowerCenter, IBM InfoSphere, Pentaho)
  • SQL development, preferably in multiple database management platforms, and working with normalized relational databases and dimensional data warehouse implementation
  • Ability to manage multiple projects simultaneously and deliver results in a timely manner
  • Ability to work independently, under pressure, and adaptable to change
  • Manufacturing experience and SAP knowledge are a plus

Responsibilities

  • Builds ETL data pipelines using Talend tool portfolio and SQL code.
  • Models Database objects to fulfil data pipeline requirements
  • Designs following integrations:
  • ETL jobs using incremental load patterns, using technologies like Change Data Capture (CDC) or Change Tracking
  • Services for APIs using technologies such as REST to be consumed synchronously by client application
  • Subscription based workflows triggering ETL actions based on events at source system
  • Embedded mapping and casting of data from heterogenous source and target systems and formats
  • Responsible for development, testing, documentation and performance of data pipelines, understanding and optimizing impact on source and target systems.
  • Works closely with:
  • Business analysts, system owners to gain understanding of business processes and corporate data
  • Business intelligence developers to ensure that integrations are correct and performing optimally.
  • Contribute to architectural decisions to support business processes
  • Provide production support for data solutions
  • Complete root cause analysis and contribute to remediation planning and implementation
  • Perform data quality analysis, report data quality issues and propose solutions for data quality management

FAQs

What is the job title for this position?

The job title for this position is Data Engineer.

Where is the job location?

The job location is in Bangalore.

What type of employment is being offered?

This is a permanent and regular employment position.

What work style is required for this position?

The work style required for this position is hybrid.

What is the main responsibility of a Data Engineer at Magna?

The main responsibility of a Data Engineer at Magna is to build and orchestrate synchronous and asynchronous data pipelines integrating heterogeneous business systems for both EAI and BI use cases.

What tools and technologies are preferred for this role?

Preferred tools and technologies include Talend, SQL, Azure Synapse, Data Factory, and Data Lake, among others.

What qualifications are required for this position?

The preferred qualification is a Bachelor’s in Information Technology or a related field, along with 3+ years of ETL development experience using T-SQL, Talend, or other ETL tools.

Is manufacturing experience considered a plus for this role?

Yes, manufacturing experience and SAP knowledge are considered a plus for this role.

What type of integration skills are required?

Familiarity with data integration patterns across various functions of the enterprise and architectural understanding of data hub oriented integrations are required.

Do we have any specific requirements regarding communication skills?

Yes, the ability to read, interpret, analyze, and communicate effectively both verbally and in written form is required.

Is there an emphasis on diversity in the workplace?

Yes, Magna is proud to be an equal opportunity employer and believes that a diverse workforce is critical to its success.

What kind of support does Magna offer its employees?

Magna invests in its employees by providing support and resources needed for success, offering a dynamic environment with varied responsibilities and a wide range of development prospects.

What is the expected experience level for applicants?

Applicants are expected to have 3+ years of ETL development experience, preferably in various database management platforms.

Will I be required to work on multiple projects simultaneously?

Yes, the ability to manage multiple projects simultaneously and deliver results in a timely manner is important for this role.

Forward. For All.

Manufacturing & Electronics
Industry
10,001+
Employees
1957
Founded Year

Mission & Purpose

We see a future where everyone can live and move without limitations. That’s why we are developing technologies, systems and concepts that make vehicles safer and cleaner, while serving our communities, the planet and, above all, people. Forward. For all.