Senior Data Engineer
Employee | Tech | Professional | Philippines | Makati | 2024-12-13 | REQ-10086155
Data Engineer
Responsibilities
- Implement and maintain data workflows, ETL / ELT processes, and pipelines to move identified data into target platforms for further consumption and integration as required by product owners.
- Design and implement identified data processes and storage such as usage of databases, data warehouses, data marts, and data lakes with data security in mind.
- Build supporting tooling and procedures needed for data movement and monitoring activities.
- Implement available automations for data movement processes.
- Ensure delivered workflows and processes meet expected quality outputs through conducting testing.
- Document specs and implementations of deliverables mentioned.
- Work with operations teams for maintenance and continuous improvement of workflows and pipelines.
- Work on distributed Data processing and database with Distribution & partitioning
- Ability to perform tasks related to end-to-end Data Journey including Reporting.
- Ensure integrated data pipeline validation is performed.
Job Description:
We are looking for you, if you:
- You have experience in data processing using Azure Data Factory,
- Worked with Power BI Service or Power BI Report Server and have experience in dashboard creation (incl. DAX) and administration,
- Know SQL and SQL Server/Oracle Database,
- Have knowledge of methodologies for creating data warehouses and designing ETL processes,
- Have expertise with the implementation of programming solutions on large data sets, statistical analysis Plans and technical specifications documents,
- Are a naturally collaborative person who listens and invests in others to achieve common goals,
- Love to challenge the status quo and are eager to propose creative solutions to problems,
- Have ability to quickly adopt to change and still complete your tasks,
- Have good communication skills, writing and verbal in English.
You will get extra points for:
- Experience with Business Intelligence tools such as Visual Analytics,
- Basic SAS knowledge,
- Knowledge about Credit Risk and how bank works,
- Azure DevOps.
Your responsibilities:
- Building scalable and efficient pipelines in Azure Data Factory,
- Translate the business requirements into strong visualizations in Power BI,
- Development of Business Intelligence environment,
- Architectural improvements,
- Documentation – technical and for business users.
Information about the squad:
- As a Data Engineer, you will be part of ING Hubs Poland. You will be involved in data processing automation, data structures development, dashboards preparation.
- You will be working in an Agile environment by being a member of a multidisciplinary team of 5 to 9 specialists. Your colleagues will have a background in Data Analytics, Data Management, Reporting in the Credit Risk domain.
Nice to have
- Proficiency and experience in programming languages such as Python, shell scripting