Senior Data Engineer Job at BrickRed Systems, Salem, OR

ZFdTZGZjVGNjbVJBWjBFK2VNSU1lUEhaRkE9PQ==
  • BrickRed Systems
  • Salem, OR

Job Description

We are looking for a Senior Data Engineer with expertise in Big Data, Spark, and Cloud technologies to join our team. If you have a strong background in designing, developing, and optimizing complex data pipelines , this role is for you!

Key Responsibilities:

  • Design, develop, and support high-performance data pipelines for large-scale data processing.
  • Work with Apache Spark (batch & streaming) to transform and analyze massive datasets.
  • Utilize advanced SQL for data analysis and interaction.
  • Build and optimize cloud-scale data lake solutions in Databricks, AWS EMR, Snowflake , and other Big Data environments.
  • Implement Python-based scripting for automation and data processing.
  • Ensure performance tuning and optimization of large datasets .
  • Leverage GitHub for source control and adhere to best practices in development.
  • Work with workflow scheduling tools like Airflow or Databricks Workflow .
  • Collaborate with cross-functional teams, influencing stakeholders through effective communication.

Must-Have Skills:

  • 5+ years of experience in designing and developing complex data pipelines .
  • 5+ years of experience with Spark (batch & streaming mode) .
  • 5+ years of experience with SQL for advanced analytics.
  • 5+ years in Big Data environments (Databricks, AWS EMR, etc.).
  • 3+ years of Python scripting experience.
  • 3+ years of experience in AWS or other cloud platforms .
  • Strong knowledge of solution & technical design for scalable data architectures.
  • Experience with relational databases, Snowflake, and Data Warehouse concepts .
  • Hands-on experience in workflow scheduling tools (Airflow, Databricks Workflow).
  • Expertise in performance tuning of large datasets .

Nice-to-Have Skills:

  • Familiarity with data governance and security best practices .
  • Experience with CI/CD for data pipelines .

About BrickRed Systems:

BrickRed Systems is a global leader in next-generation technology, consulting, and business process service companies. We enable clients to navigate their digital transformation. BrickRed Systems delivers a range of consulting services to our clients across multiple industries around the world. Our practices employ highly skilled and experienced individuals with a client-centric passion for innovation and delivery excellence.

With ISO 27001 and ISO 9001 certification and over a decade of experience in managing the systems and workings of global enterprises, we harness the power of cognitive computing hyper-automation, robotics, cloud, analytics, and emerging technologies to help our clients adapt to the digital world and make them successful. Our always-on learning agenda drives their continuous improvement through building and transferring digital skills, expertise, and ideas from our innovation ecosystem.

Job Tags

Similar Jobs

Total Quality Logistics

Inside Sales Representative Job at Total Quality Logistics

 ...timely pickup and delivery Provide proactive and honest communication, internally and externally What you need: College degree preferred, but no degree required Availability to work full-time, 100% in-office Determination to outwork anyone Strong negotiation... 

NYC Health + Hospitals

Patient Care Associate, Correctional Health Services **Day Tour, Part-time** OTxHU Job at NYC Health + Hospitals

 ...of health care in the New York City jails. Deeply committed to human dignity and patient rights, CHS is part of the NYC Health + Hospitals system and is a key partner in the Citys efforts to reform the criminal-legal system. Our in-jail clinical services include medical... 

Valiant-X Enterprise Corporation

System Engineer Job at Valiant-X Enterprise Corporation

 ...challenging projects and contribute to the success of critical defense programs. Key Responsibilities: Collaborate with stakeholders...  ...Required Qualifications: Bachelor's degree in Engineering, Computer Science, or related field. Minimum of 5 years of experience... 

Workrise

Document Control Specialist Job at Workrise

 ...remote) Summary : The main function of a Data Management Specialist is to manage and...  ...Control Clerk is also responsible for data entry within the document control group....  ...interpersonal skills. ~ Expert ability to work independently and manage one's time. ~ Expert... 

Magellan Financial & Insurance Services, Inc.

Administrative Assistant Job at Magellan Financial & Insurance Services, Inc.

 ...Administrative Assistant Join a Growing Financial Firm in Cookeville, TN! Are you a detail-oriented, organized, and proactive professional looking for an opportunity to be at the heart of a growing financial firm? Personalized Retirement Solutions , led by Aaron...