Azure Data Engineer (Remote)
Company: Merchants Fleet Management
Location: Tulsa
Posted on: August 7, 2022
Job Description:
The Data Engineer will be responsible for designing and
developing scalable, flexible, and high-performing data pipelines
that feed our cloud-based Data Infrastructure Platform in Azure. -
The Cloud Data Engineer's broad experience with data management
technologies will enable matching the right technologies to the
required schemas and workloads. You will partner with business
users, senior architects, and infrastructure engineers to form
complete end-to end-solutions. We are looking for an Engineer who
will thrive in an evolving fast-paced environment and bring a work
style that is marked by high energy, flexibility, quick learning,
and collaboration. Location: - Hooksett, NH - / - Rosemont, IL - /
Remote Check out the other benefits that Merchants Fleet has to
offer . - Take a peek at the culture on the Technology team: What
your day looks like:
- Design and build extensible data acquisition and integration
solutions to meet the functional and non-functional requirements of
the business
- Build and maintain serverless data pipelines using Azure cloud
services - Azure Data Factory, Azure Logic Apps, Azure Functions,
Azure Streaming Analytics, Azure Event Hubs, and Azure
Databricks
- Build "big data", event-based solutions using Azure
technologies that can process data leveraging a Lambda architecture
pattern using Event Hubs and Azure Functions
- Build PySpark data processing functions that are scalable,
parameter driven, and reusable across various data processing
patterns
- Incorporate new data sources from external vendors using
streams, flat files, APIs, and databases
- Build Azure Data Lake Gen2 structures and entities for
consumption by the Snowflake platform and other transactional
applications
- Maintain and provide support for the existing data pipelines
using Python and SQL
- Plan & execute using agile methodologies, developing &
delivering within predefined sprints
- Develop and implement tests to ensure data quality across all
integrated data sources
- Eager to explore how machine learning and artificial
intelligence can support business objectives The skills you bring:
- Solid understanding of Azure Data Lake and Azure Data Factory
best practices
- Proficient with building a scalable and discoverable Azure Data
Lake architecture
- Understanding of Data Vault2.0 and when to leverage that data
modeling approach
- Working knowledge of Power BI reporting applications
- History of working successfully with cross-functional
engineering teams
- Strong organizational and interpersonal skills; Excellent
verbal and written communication skills
- Must be able to effectively handle multiple deliverables
simultaneously in a deadline driven environment
- Strong knowledge of streaming data architecture, streaming data
pipelines and event-based data integration architectures
- Ability to succeed in a fast paced, matrix structured
environment The experience and education you have:
- Minimum of three (3) years' experience designing, building, and
optimizing data integration architectures across batch, near
real-time, and streaming integration requirements
- Must have experience with deploying Azure Data Factory
pipelines and managing these objects in a CI/CD process
- Experience with building real-time, event-based solutions in a
high-volume data environment
- Progressive experience with Azure Data Integration services
including Azure Functions, Azure Data Factory, Streaming Analytics,
and Event Hubs
- Progressive experience working with Azure Gen2 Data Lake and
the different file types that are most common for structured data
(e.g., Avro, Parquet, etc.)
- Prior experience with relational databases (Microsoft SQL
Server preferred)
- In-depth knowledge of SQL and Python languages
- Experience analyzing data for data quality and supporting the
use of data in an enterprise setting
- Working knowledge of the Snowflake data platform and
integration techniques with Azure Data Lake and Data Pipelines
- Understanding of Restful Web services / Microservices
architectures
- Experience with building integration architectures in a mixed
data platform landscape - Snowflake and Azure Data Lake
Storage
- Bachelor's degree in computer science, engineering, or data
science Merchants Fleet is the nation's fastest growing fleet
management company, providing flexible funding and service options
for organizations that leverage vehicles to run their operations,
serving as a single source for all vehicle needs, including
electric vehicles. From financing and charging to maintenance and
remarketing, Merchants has collaborated with dozens of OEMs,
charging, data and upfit partners to ensure every client is
connected to the service, technology platforms, and products that
will support their fleet in making the transition to EV. Merchants
Fleet is headquartered in Hooksett, New Hampshire, and its
Innovation Center is located in the Chicago, Illinois area.
Merchants is an award-winning place to work with accolades
including; Best & Brightest, Best Company to Work For 2015-2021,
Great Place to Work and Coolest Company for Young Professionals. -
#LI-CC1 #LI-RemoteTo provide all candidates with the highest level
of our attention, Merchants Fleet does not accept uninvited
solicitations or resumes from third parties. California Residents
click for California Consumer Privacy Act (CCPA). .
Keywords: Merchants Fleet Management, Tulsa , Azure Data Engineer (Remote), Engineering , Tulsa, Oklahoma
Didn't find what you're looking for? Search again!
Loading more jobs...