LEAD ENGINEER, DATA

Company: Disability Solutions
Location: Houston
Posted on: October 10, 2024

Job Description:

CenterPoint Energy and its predecessor companies have been in business for more than 150 years. Our Vision: Our vision is to become the most admired utility in the United States through the execution of our long-term growth strategy. We have an unwavering commitment to safely and reliably deliver electricity and natural gas to millions of people. Our Commitment: CenterPoint Energy is committed to creating an inclusive work environment where business results are achieved through the skills, abilities and talents of our diverse workforce. At CenterPoint Energy, individuals are respected for their contributions toward our company objectives. We strive for an inclusive work environment across all levels that is reflective of the available workforce in the communities we serve. Job SummaryAs a Lead Data Engineer, you will be responsible for developing and maintaining data pipelines that support analytical analysis. You will partner with various business clients, data scientists, and data analysts to ensure that the company has access to the data it needs to make informed decisions. You will also be responsible for leading and mentoring junior data engineers.Essential Functions

• Develop, construct, test and maintain data acquisition pipelines for large volumes of structed and unstructured data. This includes batch and real-time processing.
• Build large and complex datasets based on business requirements.
• Construct 'big data' pipeline architecture.
• Identifies opportunities for data acquisition via working with stakeholders and business clients.
• Leverages a variety of tools such as Python, SAP Data Services, DataFlow, DataStream, Google Cloud Functions, Spark, Google Cloud Run, SAP SLT, Google Pub Sub, and etc. to integrate systems and data pipelines.
• Recommends ways to improve data quality, reliability, and efficiency.
• Develop JSON messaging structure for integrating with various applications.
• Drive a data engineering strategy focused on delivering data in near real-time using serverless technologies.
• Develop data architecture to optimize performance for dashboards and digital applications.
• Lead the integration track of various strategic projects.
• Leverage DevOps and CI/CD practices to ensure the reliability and scalability of data pipelines. Education DescriptionRequires a bachelor's degree in accounting, Data Science, Data Engineering, Information Technology from an accredited college or university.Experience
  • Requires 7+ years of experience in a data engineering role.
  • Strong SQL background working with a variety of data sources.
  • Expert using languages such as Python, Java, or Spark.
  • Expert leveraging messaging queue technologies such as Kafka and Pub/Sub.
  • Expert transforming streaming data using technologies such as DataFlow, DataStream, Spark streaming, or DataBricks.
  • Expert developing resilient and scalable data models.
  • Expert developing pipelines for unstructured data.
  • Expert in native cloud back-end technologies such as BigQuery, DataFlow, Pub/Sub, Cloud Functions, Cloud Run.
  • Expertise with cloud-based data platforms such as AWS, Azure, or GCP.
  • Experience with AI and ML ops.
  • Experience with AI and machine learning.
  • Expertise with DevOps and deploying and maintaining CI CD pipelines. Physical Requirements
    • Able to communicate either written and verbal communications either in person or through technical equipment such as telephone.
    • Able to demonstrate and apply the manual dexterity to operate a personal computer and common office equipment.
    • Able to sit, stand or walk for long periods of time.
    • Able to exert up to 10 pounds of force occasionally, and/or a minimal amount of force frequently to lift, carry, push, pull, or otherwise move objects. Working Conditions
      • Required to participate in CenterPoint Energy's Emergency Operation Plan (EOP). We want you to know Being a part of the CenterPoint Energy team is more than a career alone. It's an opportunity to make a positive impact. You will be an integral part of enabling everyday life and the pursuit of possibilities for the customers we serve and the communities we share. The vital services we provide are at the core of making our world work, and by sharing your energy with us, we'll create a better tomorrow together. Diversity, Equity and Inclusion CenterPoint Energy is committed to creating an inclusive work environment where business results are achieved through the skills, abilities and talents of our diverse workforce. At CenterPoint Energy, individuals are respected for their contributions toward our company objectives. We strive for an inclusive work environment across all levels that is reflective of the available workforce in the communities we serve. What we bring to you
        • Competitive pay
        • Paid training
        • Benefits eligibility begins on your first day
        • Transit subsidies
        • Flexible work schedule, paid holidays and paid time off
        • Access to discounts at fitness clubs and an on-site wellness center at our headquarters in Houston
        • Professional growth and development programs including tuition reimbursement
        • 401(k) Savings Plan featuring a company match dollar-for-dollar up to 6% and a company contribution of 3% regardless of your contribution Job Type: Full Time Posting Start Date: 10/08/2024 Posting End Date: 10/18/2024 This contractor and subcontractor shall abide by the requirements of 41 CFR ---- 60-1.4(a), 60-300.5(a), and 60-741.5(a). These regulations prohibit discrimination against qualified individuals based on their status as protected veterans or individuals with disabilities and prohibit discrimination against all individuals based on their race, color, religion, sex, sexual orientation, gender identity, or national origin. Moreover, these regulations require that covered prime contractors and subcontractors take affirmative action to employ and advance in employment individuals without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, protected veteran status or disability. #LI-CNP

Keywords: Disability Solutions, College Station , LEAD ENGINEER, DATA, Engineering , Houston, Texas