Job Description

Location: This position will be on-site at our corporate offices in Allen, Texas (Dallas-Fort Worth area). **Not a remote position.

This is a full-time W-2 ONSITE opportunity (not remote)!

Work Eligibility:

• Candidates must be legally authorized to work in the United States without requiring employer-sponsored visa sponsorship now or in the future.
• At this time, we are unable to consider candidates on F1-OPT, H1B, or CPT status.

We are seeking an experienced Data Engineer with 10+ years of professional experience, specifically focused on developing Data pipelines, Data Lakes, and data warehouses for structured and unstructured data from millions of IoT Devices transmitting data to the cloud. The ideal candidate will have a strong technical knowledge of relational and NoSQL DB, data migration, data wrangling, Pre/Post post-processing, and Database administration. The candidate will have excellent problem-solving skills and a proven track record of delivering high-quality Data warehousing solutions. The candidate must be authorized to work in the US for any employer.

Responsibilities:

• Ensure the high availability, low latency, high performance, efficiency, and stability of critical data infrastructure, supporting a range of data platforms for micro-services, APIs, and custom backend Java/JEE components.
• An Expert in the design and development of real-time and offline batch processing of data pipelines for various custom enterprise Java Applications on AWS cloud systems.
• An Expert in setting up different databases between environments, for multiple applications.
• Expert at continuous data releases for different products and transferring data between environments.
• Collaborate with Software and firmware development teams to design and implement solutions that create analytics, reporting, and related monitoring solutions.
• Optimize resources (DB, Network Configuration,s etc.) utilization and minimize unnecessary expenditure on IT Data infrastructure.
• Develop and maintain Confluence documentation for tools and pipelines.
• Collaborate frequently with software developers to configure AWS Cloud IT Data security, QA, and integration development environments.

Requirements:

• Building Data Pipelines to extract data from multiple sources and make data usable for business objectives.
• Building Data Warehousing to prepare structured and unstructured data for use in analytics and reporting.
• Building Data Lakes to manage large volumes of data, to move, transform, and analyze the data between cloud and on-premises.
• Expertise in Data and Database migrations between different environments and applications. Work as a DBA, ability to manage and transfer the data between different applications.
• Expert-level knowledge in the following areas: 
  • Infrastructure (AWS, Docker or related)
  • Database (MySQL, MongoDB, InfluxDB or similar time series)
  • DB SQL Languages (SQL, NoSQL, Python)
  • ETL/Batch processes (Spring Batch, Java)
  • Big Data (Hadoop, Apache Spark, Apache Parquet or similar)
• Excellent communication skills both vertically and horizontally within the organization related to all aspects of technical leadership – written and verbal.

Desired Qualifications:

• Experience in setting CICD /DevOps for Data Management.
• Experience in managing APIs via Gateway, SWAGGER or similar tools for exposing data.
• Experience in securing all the custom data and DB on AWS.
• Experience in setting up data ingest points for real-time IOT applications.
• Familiarity with TLS 1.2/1.3 implementations.
• Understanding of electrical systems and power distribution.

Benefits:

Salary and Benefits: We offer a competitive salary and performance-based bonus program, top-tier benefits package, including medical, dental, and vision insurance, 401(k), and paid time off.

Job Tags

Similar Jobs