Logo of Huzzle

Data Engineer

  • Job
    Full-time
    Mid Level
  • Data
    IT & Cybersecurity
  • Bangalore

AI generated summary

  • You should have 3+ years of ETL experience, SQL proficiency, cloud knowledge (Azure), data integration skills, and the ability to manage projects in various methodologies. Manufacturing and SAP experience are a plus.
  • You will build ETL pipelines, model databases, design integrations, optimize performance, collaborate with teams, ensure data quality, and provide production support for data solutions.

Requirements

  • Familiarity with various relational and non-relational database management systems, in particular Microsoft classic and cloud ecosystem
  • Architectural understanding of data hub oriented integrations as single point of orchestration
  • Hands on knowledge in the design of data flows that facilitate data harvesting for automated genealogy documentation in a data catalog
  • Able to work in various delivery methodologies (Agile – Scrum/SAFe, Waterfall, Kanban, etc.)
  • Ability to read, interpret, analyze, and communicate effectively verbally and in written form
  • Familiarity with UML Sequence diagrams
  • Knowledge of data integration patterns across various functions of the enterprise
  • Experience with cloud-based solutions preferably on Microsoft stack
  • Azure Synapse
  • Data Factory
  • Data Lake
  • Experience implementing and supporting scalable solutions, with a solid understanding of database locking escalation and other concurrency related mechanisms
  • Understanding of when and how to use table partitioning and other data insertion, storage and distribution approaches
  • Bachelor’s in Information Technology or a related field (experience will be considered in lieu of education requirement)
  • 3+ years of
  • ETL development experience with T-SQL, Talend or other graphical ETL tools (Datastage, SSIS, Informatica, Ab Initio, PowerCenter, IBM InfoSphere, Pentaho)
  • SQL development, preferably in multiple database management platforms, and working with normalized relational databases and dimensional data warehouse implementation
  • Ability to manage multiple projects simultaneously and deliver results in a timely manner
  • Ability to work independently, under pressure, and adaptable to change
  • Manufacturing experience and SAP knowledge are a plus

Responsibilities

  • Builds ETL data pipelines using Talend tool portfolio and SQL code.
  • Models Database objects to fulfil data pipeline requirements
  • Designs following integrations:
  • ETL jobs using incremental load patterns, using technologies like Change Data Capture (CDC) or Change Tracking
  • Services for APIs using technologies such as REST to be consumed synchronously by client application
  • Subscription based workflows triggering ETL actions based on events at source system
  • Embedded mapping and casting of data from heterogenous source and target systems and formats
  • Responsible for development, testing, documentation and performance of data pipelines, understanding and optimizing impact on source and target systems.
  • Works closely with:
  • Business analysts, system owners to gain understanding of business processes and corporate data
  • Business intelligence developers to ensure that integrations are correct and performing optimally.
  • Contribute to architectural decisions to support business processes
  • Provide production support for data solutions
  • Complete root cause analysis and contribute to remediation planning and implementation
  • Perform data quality analysis, report data quality issues and propose solutions for data quality management

FAQs

What is the job title for this position?

The job title is Data Engineer.

Where is the job located?

The job is located in Bangalore.

What type of employment is being offered?

The employment type is Permanent/Regular.

What responsibilities will I have as a Data Engineer?

As a Data Engineer, you will build ETL data pipelines, model database objects, design integrations, provide production support for data solutions, and perform data quality analysis among other tasks.

What technologies will I need to be familiar with for this role?

You will need to be familiar with relational and non-relational databases, ETL tools like Talend, and cloud-based solutions, particularly the Microsoft Azure ecosystem.

Is experience with SAP beneficial for this role?

Yes, manufacturing experience and knowledge of SAP are considered a plus.

What are the minimum qualifications required for this job?

The minimum qualification is a Bachelor’s in Information Technology or a related field, along with 3+ years of ETL development experience.

What work methodologies does this role require familiarity with?

Familiarity with various delivery methodologies such as Agile (Scrum/SAFe), Waterfall, and Kanban is required.

Does Magna advocate for diversity in hiring?

Yes, Magna is proud to be an equal opportunity employer and values a diverse workforce.

What benefits are offered as part of this position?

Magna invests in employees with support and resources for success, as well as providing exciting and varied responsibilities.

Can I apply for this role if I do not have a degree but have relevant experience?

Yes, experience will be considered in lieu of the education requirement.

What is the company's stance on data privacy regarding job applications?

Magna takes the privacy of your personal information seriously and discourages sending applications via email to comply with GDPR requirements and local data privacy laws.

Forward. For All.

Manufacturing & Electronics
Industry
10,001+
Employees
1957
Founded Year

Mission & Purpose

We see a future where everyone can live and move without limitations. That’s why we are developing technologies, systems and concepts that make vehicles safer and cleaner, while serving our communities, the planet and, above all, people. Forward. For all.