Solution Designers - ETL,
Remote Canada

Project Description

---

Large transformation of On-prem Hadoop to AWS performed for the Canadian insurance company. Refactoring of 10,000 ETL jobs to native AWS. Moving Informatica and Qlik reporting to the cloud.

Responsibilities

---

2.1 WHAT IS A SOLUTION DESIGNER
The Solution Designer Roles and Responsibilities include designing the essential core building block's that make up a technical solution. This means producing a modular and flexible design that meets the business requirements. The Solution Designer Role is responsible for the overall integrity of solution so must have knowledge of existing system set, the company's overall systems strategy and any applicable IT standards. Solution Designers are focused around designing a solution that is as elegant, optimized, modularized and reusable as possible, ensuring the design is flexible and extensible.
Solution Designers will also be adept in communicating with business leaders from AVPs to Managers to Analysts. They will form relationships with their assigned business unit and earn their trust. They will also have an intimate knowledge of the data, how it is used, how it is stored and the business process around that data for their assigned business unit.

2.2 TECHNICAL SKILLSET
Once we complete our cloud migration journey Cloudera experience will no longer be required and focus will shift to AWS skillsets
Skillset Alternative Skillset Experience Maturity
Informatica BDM None 5 years+ High
SQL None 5 years+ High
Cloudera HortonWorks, Hadoop, HDFS 5 years+ High
Hive None 5 years+ High
PostgreSQL Any other Relational DB 5 years+ High
MongoDB Any other NoSQL DB 5 years+ High
AWS EMR HDInsight, HDP, CDP, 5 years+ High
AWS S3 Azure ADLS 5 years+ High
AWS EC2 5 years+ High
AWS RDS Any other relational DB 5 years+ High


2.3 QUALIFICATIONS / ROLES & RESPONSIBILITIES
• Interface with business project sponsors to gather, assess and interpret business needs and requirements
• Develop a data model and Data Lake design around stated use cases to capture business's KPIs, attributes, transactional data, and data transformations
• Identify the relevant on premise technology stack / AWS services and an architecture that can support business workloads/use-cases; evaluate pros/cons among the identified options before arriving at a recommended solution optimal for the business's needs.
• Be able to explain to the business the tradeoffs among the various solutions options, and why the recommended solution(s) and architecture was chosen as an optimal one for the business needs.
• Work closely with the business and broader IT delivery team to implement in Agile fashion the architecture and solution design
• Assess, document and translate goals, objectives, problem statements, etc. to offshore team and onshore management
• Advising on database performance, altering the ETL process, providing SQL transformations, discussing API integration, and deriving business and technical KPIs
• Help transition the implemented solution into the hands of the business and operations, including providing documentation the business and operations team can use to operate and maintain the solution.
• Building functional STMs
• Building solution design documents
• Building solution architecture documents
• Working with Data Architects on the overall solution / strategy
• Documenting business requirements and translating them into technical specifications
• Data profiling to validate business rules and assess data quality
• Experience supporting and working with cross-functional teams in a dynamic environment.
• Experience with big data tools: Cloudera, Hadoop, Spark, Kafka, etc.
• Experience with relational SQL and NoSQL databases: PostgreSQL, MongoDB.
• Experience with various file formats: JSON, XML, Parquet
• Experience with data pipeline and workflow management tools: Zena
• Experience with AWS cloud services: EC2, EMR, RDS, S3

Skills

---

Must have

8+ years of experience working as a solution designer in a Data / Business Intelligence teams building data lakes, warehouse & marts
4+ years of experience in Insurance Property & Casualty domain
3+ years of experience working with Big Data technologies
Strong knowledge of data solutions, data lakes (Cloudera), data warehouses, data marts
Excellent knowledge and experience in ETL with Informatica product suite
Experience/Knowledge Cloud Data Lake Design - preferably AWS technologies like S3,EMR,Redshift etc
Experience in understanding and implementation of Data Governance principles
Experience in Agile and DevOps model of Data Application design, implementation and operations
Experience in leading multiple projects under a big program with 20+ team members
Excellent background of working with multiple databases - relational, dimensional, graph, unstructured/file based etc.
Experience in Master Data Management, Data Quality, Metadata management, data discovery design and implementation - Informatica product suite preferred
Excellent background in data architectural/data modeling work in previous job profiles
Strong application design and development skills, excellent communication skills with a strong emphasis on conceptualizing and designing architectures.
Strong Data Analysis & Modeling skills
Ability to communicate ideas in both technical and user-friendly language.
Experience working in diverse multicultural environment with different vendors, onsite/offshore vendor teams etc.

Nice to have

Experience with ACORD, IIW or SAS DDS data models

Languages

---

English: B2 Upper Intermediate

Relocation package

---

If needed, we can help you with relocation process. Click here for more details: see more details