DataBricks Solution Architect

@ Long Finch Technologies
Long Finch Technologieslongfinchtechnologies.com

DataBricks Solution Architect

Matthews, North Carolina
Posted 5 days ago

About the job

A company focused on leveraging DataBricks solutions for data architecture, optimization, and performance. The role involves reviewing existing systems, code, and data flows to improve security, reduce complexity, and develop optimization strategies.

Requirements

  • Understanding data consumption
  • Experience with architecture review
  • Code review skills in Spark and SQL
  • Familiarity with Delta Lake
  • Knowledge of ETL/ELT pipelines

Qualifications

  • Experience with Databricks platform
  • Strong analytical skills
  • Detail-oriented mindset
  • Ability to identify bottlenecks
  • Problem solving skills

Full job description

Required Skills:

  • Understanding how application consume data
  • Need someone who can come in look at the architecture and code and offer optimization solution
  • Focus on performance, cost, security and governance
  • Deliver an optimization roadmap

· DataBricks Solutions architect on the application side.

· Someone who has experience with consumption of data

Responsibilities:

1. Architecture assessment

  • Review the existing Databricks architecture
  • Understand how applications consume Databricks data
  • Review data flows, integrations, APIs, SQL Warehouses, clusters, Delta tables, etc.
  • Identify architectural bottlenecks and unnecessary complexity

2. Code review
This is critical. They should be comfortable getting into the actual:

  • PySpark code
  • Spark SQL
  • Databricks notebooks
  • SQL queries
  • ETL/ELT pipelines
  • Delta Lake implementation
  • Streaming code,
Show full description

Similar jobs in Matthews, North Carolina

See all DataBricks Solution Architect jobs