Skip to content
View danlevimb's full-sized avatar

Block or report danlevimb

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
danlevimb/README.md

Dan Levi

Data Engineer · SQL Server & ETL · Azure Data Infrastructure & Reliability

Building reliable, observable, and governed data systems.

LinkedIn Portfolio Email


Profile

I’m a Data Engineer with a strong foundation in SQL Server, ETL, data infrastructure, and operational reliability, now focused on Azure Data Engineering.

My work centers on a simple idea: data platforms should be predictable under normal conditions, observable when they fail, recoverable when something goes wrong, and trustworthy for downstream consumers.

Across the portfolio, I work with ingestion, orchestration, Lakehouse patterns, analytical serving, real-time processing, production readiness, and governance — with reliability as the common thread.


Selected engineering work

Project Engineering focus
Azure Real-Time Analytics Pipeline Event Hubs, KQL, Raw/Parsed/Canonical modeling, stream integrity, timeliness, reconciliation, state reconstruction, operational observability
Production-Ready Azure Data Pipeline ADF, Managed Identity, RBAC, Key Vault, Bicep, GitHub Actions, Log Analytics, KQL diagnostics, Azure Monitor alerts
Azure Databricks Delta Lakehouse PySpark, Delta Lake, Bronze/Silver/Gold, MERGE, SCD Type 2, Time Travel, data quality
Azure ADF Incremental Ingestion Framework Metadata-driven orchestration, SQL Server integration, watermarks, incremental loading, retries, operational controls
SQL Server Recovery & Validation Framework Backup scheduling, restore-chain planning, PITR, marked transactions, canary validation, recovery telemetry
Azure Data Governance & Lineage POC Microsoft Purview, discovery, classification, stewardship, glossary metadata, Managed Identity, ADF lineage

Engineering focus

Reliable data infrastructure
Traceability, recoverability, data quality, observability, failure handling, operational clarity.

Azure Data Engineering
ADF, ADLS Gen2, Databricks, Delta Lake, Synapse Serverless SQL, Event Hubs, KQL, Azure Monitor, Microsoft Purview.

SQL Server & ETL
T-SQL, SSIS, performance tuning, backup/recovery, HA/DR, production support, operational troubleshooting.

Production-aware engineering
Managed Identity, RBAC, Key Vault, Infrastructure as Code, CI validation, diagnostics, alerting, and cost-aware resource decisions.


Core stack

SQL Server · T-SQL · SSIS · Python · Azure Data Factory · ADLS Gen2 · Databricks · PySpark · Delta Lake · Synapse Serverless SQL · Event Hubs · KQL · Azure Monitor · Microsoft Purview · Bicep · GitHub Actions


Engineering principles

  • Make failures visible instead of hiding them.
  • Preserve enough evidence to explain what happened.
  • Design recovery paths before they are needed.
  • Separate physical delivery from logical truth.
  • Keep business logic reusable and presentation layers thin.
  • Prefer explicit scope boundaries over inflated claims.

Additional work


Background

My engineering background predates the Azure portfolio.

I’ve worked with SQL Server administration, ETL, production databases, performance tuning, backup and recovery, infrastructure, and operational support. The Azure work extends that same reliability mindset into modern data platforms rather than replacing it.


Connect

Pinned Loading

  1. azure-real-time-analytics-pipeline azure-real-time-analytics-pipeline Public

    Azure real-time Data Engineering pipeline using Event Hubs and KQL, with stream reliability, state reconstruction, Gold serving, and operational observability.

    Python 1

  2. production-ready-azure-data-pipeline production-ready-azure-data-pipeline Public

    Production-ready Azure Data Factory pipeline with Managed Identity, Key Vault, Bicep, GitHub Actions validation, Log Analytics, KQL diagnostics, and Azure Monitor alerting.

    PowerShell 1

  3. azure-adf-incremental-ingestion-framework azure-adf-incremental-ingestion-framework Public

    Metadata-driven incremental ingestion framework using Azure Data Factory, SQL Server, ADLS Gen2, control tables, watermarks, and operational validation evidence.

    TSQL

  4. azure-databricks-delta-lakehouse azure-databricks-delta-lakehouse Public

    Azure Databricks Delta Lakehouse project using PySpark, Delta Lake, Bronze/Silver/Gold layers, MERGE, SCD Type 2, time travel, and data quality validation.

    Python

  5. azure-synapse-serverless-serving-layer azure-synapse-serverless-serving-layer Public

    Azure Synapse Serverless SQL serving layer over ADLS Gen2 with external tables, reporting views, CETAS, data quality checks, and cost-aware querying.

    TSQL

  6. sql-server-recovery-validation-framework sql-server-recovery-validation-framework Public

    SQL Server backup, restore-chain, PITR, and recovery-validation framework focused on reliability, traceability, and operational resilience.

    TSQL