Position

Solution Designers - ETL,
Remote Canada

Location


Remote Canada

Office Address


Project Description


Large transformation of On-prem Hadoop to AWS performed for the Canadian insurance company. Refactoring of 10,000 ETL jobs to native AWS. Moving Informatica and Qlik reporting to the cloud.

Responsibilities


    2.1 WHAT IS A SOLUTION DESIGNER
    The Solution Designer Roles and Responsibilities include designing the essential core building block's that make up a technical solution. This means producing a modular and flexible design that meets the business requirements. The Solution Designer Role is responsible for the overall integrity of solution so must have knowledge of existing system set, the company's overall systems strategy and any applicable IT standards. Solution Designers are focused around designing a solution that is as elegant, optimized, modularized and reusable as possible, ensuring the design is flexible and extensible.
    Solution Designers will also be adept in communicating with business leaders from AVPs to Managers to Analysts. They will form relationships with their assigned business unit and earn their trust. They will also have an intimate knowledge of the data, how it is used, how it is stored and the business process around that data for their assigned business unit.

    2.2 TECHNICAL SKILLSET
    Once we complete our cloud migration journey Cloudera experience will no longer be required and focus will shift to AWS skillsets
    Skillset Alternative Skillset Experience Maturity
    Informatica BDM None 5 years+ High
    SQL None 5 years+ High
    Cloudera HortonWorks, Hadoop, HDFS 5 years+ High
    Hive None 5 years+ High
    PostgreSQL Any other Relational DB 5 years+ High
    MongoDB Any other NoSQL DB 5 years+ High
    AWS EMR HDInsight, HDP, CDP, 5 years+ High
    AWS S3 Azure ADLS 5 years+ High
    AWS EC2 5 years+ High
    AWS RDS Any other relational DB 5 years+ High


    2.3 QUALIFICATIONS / ROLES & RESPONSIBILITIES
    • Interface with business project sponsors to gather, assess and interpret business needs and requirements
    • Develop a data model and Data Lake design around stated use cases to capture business's KPIs, attributes, transactional data, and data transformations
    • Identify the relevant on premise technology stack / AWS services and an architecture that can support business workloads/use-cases; evaluate pros/cons among the identified options before arriving at a recommended solution optimal for the business's needs.
    • Be able to explain to the business the tradeoffs among the various solutions options, and why the recommended solution(s) and architecture was chosen as an optimal one for the business needs.
    • Work closely with the business and broader IT delivery team to implement in Agile fashion the architecture and solution design
    • Assess, document and translate goals, objectives, problem statements, etc. to offshore team and onshore management
    • Advising on database performance, altering the ETL process, providing SQL transformations, discussing API integration, and deriving business and technical KPIs
    • Help transition the implemented solution into the hands of the business and operations, including providing documentation the business and operations team can use to operate and maintain the solution.
    • Building functional STMs
    • Building solution design documents
    • Building solution architecture documents
    • Working with Data Architects on the overall solution / strategy
    • Documenting business requirements and translating them into technical specifications
    • Data profiling to validate business rules and assess data quality
    • Experience supporting and working with cross-functional teams in a dynamic environment.
    • Experience with big data tools: Cloudera, Hadoop, Spark, Kafka, etc.
    • Experience with relational SQL and NoSQL databases: PostgreSQL, MongoDB.
    • Experience with various file formats: JSON, XML, Parquet
    • Experience with data pipeline and workflow management tools: Zena
    • Experience with AWS cloud services: EC2, EMR, RDS, S3

Skills


Must have

    8+ years of experience working as a solution designer in a Data / Business Intelligence teams building data lakes, warehouse & marts
    4+ years of experience in Insurance Property & Casualty domain
    3+ years of experience working with Big Data technologies
    Strong knowledge of data solutions, data lakes (Cloudera), data warehouses, data marts
    Excellent knowledge and experience in ETL with Informatica product suite
    Experience/Knowledge Cloud Data Lake Design - preferably AWS technologies like S3,EMR,Redshift etc
    Experience in understanding and implementation of Data Governance principles
    Experience in Agile and DevOps model of Data Application design, implementation and operations
    Experience in leading multiple projects under a big program with 20+ team members
    Excellent background of working with multiple databases - relational, dimensional, graph, unstructured/file based etc.
    Experience in Master Data Management, Data Quality, Metadata management, data discovery design and implementation - Informatica product suite preferred
    Excellent background in data architectural/data modeling work in previous job profiles
    Strong application design and development skills, excellent communication skills with a strong emphasis on conceptualizing and designing architectures.
    Strong Data Analysis & Modeling skills
    Ability to communicate ideas in both technical and user-friendly language.
    Experience working in diverse multicultural environment with different vendors, onsite/offshore vendor teams etc.

Nice to have

    Experience with ACORD, IIW or SAS DDS data models

Languages


English: B2 Upper Intermediate

Relocation package


If needed, we can help you with relocation process. Click here for more details: see more details

Work Type


ETL (Informatica, Ab Initio etc.)

Ref Number


VR-57127

Explore More

LoGeek Magazine
icon Logeek Luxoft
Learn more
Events
icon Events Luxoft
Learn more
Relocation Program
icon Relocation Luxoft
Learn more
Referral
Platform
icon Referral Luxoft
Learn more
Students
and Grads
icon Students Luxoft
Learn more