Azure Data Engineer (Remote)

Company: Merchants Fleet Management
Location: Tulsa
Posted on: August 7, 2022

Job Description:

The Data Engineer will be responsible for designing and developing scalable, flexible, and high-performing data pipelines that feed our cloud-based Data Infrastructure Platform in Azure. - The Cloud Data Engineer's broad experience with data management technologies will enable matching the right technologies to the required schemas and workloads. You will partner with business users, senior architects, and infrastructure engineers to form complete end-to end-solutions. We are looking for an Engineer who will thrive in an evolving fast-paced environment and bring a work style that is marked by high energy, flexibility, quick learning, and collaboration. Location: - Hooksett, NH - / - Rosemont, IL - / Remote Check out the other benefits that Merchants Fleet has to offer . - Take a peek at the culture on the Technology team: What your day looks like:

• Design and build extensible data acquisition and integration solutions to meet the functional and non-functional requirements of the business
• Build and maintain serverless data pipelines using Azure cloud services - Azure Data Factory, Azure Logic Apps, Azure Functions, Azure Streaming Analytics, Azure Event Hubs, and Azure Databricks
• Build "big data", event-based solutions using Azure technologies that can process data leveraging a Lambda architecture pattern using Event Hubs and Azure Functions
• Build PySpark data processing functions that are scalable, parameter driven, and reusable across various data processing patterns
• Incorporate new data sources from external vendors using streams, flat files, APIs, and databases
• Build Azure Data Lake Gen2 structures and entities for consumption by the Snowflake platform and other transactional applications
• Maintain and provide support for the existing data pipelines using Python and SQL
• Plan & execute using agile methodologies, developing & delivering within predefined sprints
• Develop and implement tests to ensure data quality across all integrated data sources
• Eager to explore how machine learning and artificial intelligence can support business objectives The skills you bring:
  • Solid understanding of Azure Data Lake and Azure Data Factory best practices
  • Proficient with building a scalable and discoverable Azure Data Lake architecture
  • Understanding of Data Vault2.0 and when to leverage that data modeling approach
  • Working knowledge of Power BI reporting applications
  • History of working successfully with cross-functional engineering teams
  • Strong organizational and interpersonal skills; Excellent verbal and written communication skills
  • Must be able to effectively handle multiple deliverables simultaneously in a deadline driven environment
  • Strong knowledge of streaming data architecture, streaming data pipelines and event-based data integration architectures
  • Ability to succeed in a fast paced, matrix structured environment The experience and education you have:
    • Minimum of three (3) years' experience designing, building, and optimizing data integration architectures across batch, near real-time, and streaming integration requirements
    • Must have experience with deploying Azure Data Factory pipelines and managing these objects in a CI/CD process
    • Experience with building real-time, event-based solutions in a high-volume data environment
    • Progressive experience with Azure Data Integration services including Azure Functions, Azure Data Factory, Streaming Analytics, and Event Hubs
    • Progressive experience working with Azure Gen2 Data Lake and the different file types that are most common for structured data (e.g., Avro, Parquet, etc.)
    • Prior experience with relational databases (Microsoft SQL Server preferred)
    • In-depth knowledge of SQL and Python languages
    • Experience analyzing data for data quality and supporting the use of data in an enterprise setting
    • Working knowledge of the Snowflake data platform and integration techniques with Azure Data Lake and Data Pipelines
    • Understanding of Restful Web services / Microservices architectures
    • Experience with building integration architectures in a mixed data platform landscape - Snowflake and Azure Data Lake Storage
    • Bachelor's degree in computer science, engineering, or data science Merchants Fleet is the nation's fastest growing fleet management company, providing flexible funding and service options for organizations that leverage vehicles to run their operations, serving as a single source for all vehicle needs, including electric vehicles. From financing and charging to maintenance and remarketing, Merchants has collaborated with dozens of OEMs, charging, data and upfit partners to ensure every client is connected to the service, technology platforms, and products that will support their fleet in making the transition to EV. Merchants Fleet is headquartered in Hooksett, New Hampshire, and its Innovation Center is located in the Chicago, Illinois area. Merchants is an award-winning place to work with accolades including; Best & Brightest, Best Company to Work For 2015-2021, Great Place to Work and Coolest Company for Young Professionals. - #LI-CC1 #LI-RemoteTo provide all candidates with the highest level of our attention, Merchants Fleet does not accept uninvited solicitations or resumes from third parties. California Residents click for California Consumer Privacy Act (CCPA). .

Keywords: Merchants Fleet Management, Tulsa , Azure Data Engineer (Remote), Engineering , Tulsa, Oklahoma