Establish the core Analytics Platform to enable to further develop the Supply Chain analytics capabilities. A flexible area to centrally store the Supply Chain Data and to connect with the last generation of Data Mining technologies in a high processing environment with (1)Agile Ways of Working and Speed to Market, (2)Self Service Analytics and Visualization capabilities, (3)Sharable in a secured way across Markets.(4)Integration within overall Supply Chain ecosystem. One of the requests was to provide them with near real time data load capabilities for critical Transactional data as Orders, Shipment, etc.
As part of the requested architecture, data is loaded from SAP ECC/HANA to Azure Storage Layers (Blob, ADLS, SQL DB, SQL DW, Power BI) and further perform near real time Operational Reporting to satisfy such requirements.
Candidate will independently work with the customer on Azure Databricks and Azure Data Factory along with Azure SQL server in the Supply Chain and other business units.
Hands on experience on ELT / ETL with Azure ADF and ADBWell versed working experience on Azure SQL Server
Experience in working with PySpark
Good coding experience in Spar - Scala for handling Spark Data frame with historical and incremental loading with audit log generation and data validation
ADF Parameter, Scheduling & Email Notification with Logic Apps
Azure performance tuning & administration with troubleshooting
Should have worked on Data Compression i.e. Parquet & ORC
Experience in MS SQL Server, SSIS, Azure ADF
Nice to have
English: C2 Proficient
If needed, we can help you with relocation process. Click here for more information.
Other Packaged Software
|Specialization||Position / Title||Location||Seniority||Send to a friend|
|Other Packaged Software||AWS QuickSight Engineer Data Analysis||Bangalore, IN||Regular||
|Other Packaged Software||Cloud DevOps Engineer||Bangalore, IN||Regular||
|Other Packaged Software||Integration Application Developer||Bangalore, IN||Senior||
|Other Packaged Software||Application Developer Azure Data Bricks and Python||Bangalore, IN||Regular||