Icon picture

SELVER BASIC

Senior Data Engineer and Data Architect | Azure Databricks and MS Fabric

St. Wolfgang Pl. 13 - Landshut, Germany selver.basic@gmail.com +49 1515 0284707

Profile

Data Architect and Engineer with multiple years of Azure Databricks project work and deep Python/SQL expertise. Databricks Certified Data Engineer Professional (2024) and Microsoft Fabric Data Engineer Associate, DP-700 (2026). Helped build a Databricks-native research platform supplying historical data and features to financial analysts, built pipelines for a custom marketing-data exchange, and designed customer delivery of exchange data on Microsoft Fabric. Use Delta Lake, PySpark/Spark SQL and Medallion Architecture (bronze, silver, gold) to make data reusable for analytics and machine learning. Unity Catalog access control, data quality and monitoring are central to my work with business and technical stakeholders. Keen to apply this experience to trustworthy healthcare analytics and operational decisions; freelancing since 2019, with Azure cloud experience since 2017.

Languages

  • German (C2)
  • English
  • Bosnian
  • Croatian
  • Serbian

Freelance Projects

Data architect

Customer-facing exchange-data product on Microsoft Fabric 03.2026 - 07.2026 Client: Large financial institution

Designed aspects of a customer-facing exchange-data delivery product on Microsoft Fabric, intended to make financial market data available to external customers. Planned workspace distribution across applications and environments, including ownership and capacity assignment. Assessed requirements for high-volume Spark processing (an estimated 200,000 job submissions per day), including Livy API limits, queueing, capacity and monitoring. Clarified open architecture questions with application teams and Microsoft; the work focused on design rather than a deployed implementation.

Microsoft Fabric Workspace Architecture Capacity Planning Apache Spark Livy API Data Platform Architecture

Data engineer and architect

Databricks research Data Product for financial analysts 10.2024 - present Client: Large financial institution

Led key workstreams in migrating a legacy warehouse to a Databricks-native research data product: governed historical financial datasets and features used directly by analysts for analytics and machine learning, without a custom UI. Architected a bitemporal Feature Store and security identifier mapping for point-in-time analysis. Built and optimized Delta Lake ETL/ELT pipelines processing billions of records with Unity Catalog, Delta Live Tables and bronze/silver/gold Medallion layers. Applied encryption, masking and role-based access controls; implemented monitoring and data-quality checks to support reliable reuse of the data. Automated deployments using GitHub Actions and the Databricks SDK. Aligned the target architecture with senior stakeholders and business priorities.

Databricks Lakehouse Architecture Delta Lake Unity Catalog Delta Live Tables (DLT) Lakeflow Spark Declarative Pipelines Change Data Feed (CDF) Financial Data Engineering Medallion Architecture (Bronze / Silver / Gold) Spark SQL / PySpark Streaming Pipelines Data Governance Data Quality Monitoring Encryption & Masking DevOps (GitHub Actions, dbx, SDK) Azure Databricks

Data architect

Marketing-data exchange platform architecture 04.2024 - 02.2025 Client: RTL Deutschland. & Bertelsmann

Defined the target architecture for a custom-developed marketing-data exchange that ingests marketing data for exchange and downstream reporting. Designed its end-to-end Databricks ingestion and Unity Catalog governance; assessed Azure SQL Server and Delta Lake options, including Delta Sharing, column masking, row-level security and access management. Delivered a Microsoft Fabric Lakehouse/Warehouse and Data Factory proof-of-concept to compare approaches. Translated business requirements into governed data flows and worked with stakeholders on technical trade-offs.

Databricks Microsoft Fabric Unity Catalog Azure SQL Server PostgreSQL Data Lake Delta Sharing Log Analytics Workspace Github Github Actions Alembic SQLAlchemy bash

Data engineer and lead developer

Databricks pipelines for marketing-data exchange 06.2023 - 04.2024 Client: RTL Deutschland. & Bertelsmann

Built the ingestion and ELT pipelines behind a custom marketing-data exchange, bringing data from cloud storage, REST APIs and BigQuery into governed flows for exchange and reporting. Applied Unity Catalog for access governance and used Azure SQL Server for storage. Replaced initial Azure Synapse orchestration with Databricks Workflows and deployed workflow and cluster configuration through Databricks Asset Bundles. Improved pipeline reliability with monitoring and alerting; aligned the product's data flows with stakeholders and reporting requirements.

Python Databricks Databricks asset bundles Databricks Workflows Unity Catalog Data Products Azure Synapse PostgreSQL Data Lake Log Analytics Workspace Github Github Actions Alembic Pydantic Bash

Data architect and engineer

Microsoft collaboration on designing a system for multiple Data Catalog integration 07.2022 - 06.2023 Client: Bertelsmann

This project involved the integration of various data catalogs, including Acryl (based on DataHub), Microsoft Purview, and custom catalogs sourced from databases, into a unified system — Microsoft Purview. The tasks included synchronizing entities, glossaries, and term hierarchies from external catalogs using the underlying Apache Atlas API. The solution was designed to be event-driven, leveraging Azure Event Hub and Azure Service Bus. The orchestration was implemented using Azure Durable Functions. Azure Table Storage was employed as the state store. Served as the architectural point of contact, running stakeholder workshops and aligning multiple teams on integration patterns and governance expectations.

Microsoft Purview Azure Service Bus Azure Event Hub Azure Table Services Application Insights Python Github Github Actions Azure Functions Bash Apache Atlas

Data engineer

Improving a Databricks based solution 01.2022 - 07.2022 Client: BASF

Utilized the Enterprise Data Lake Platform to prepare data for the Data Science Platform. The primary data sources were SAP systems, which provided significant daily data volumes. Pipeline orchestration was managed through a custom solution implemented in SQL Server, responsible for state management of jobs, tasks and records.

Databricks Lakehouse Data Lake Data Factory Azure DevOps SQL Server PowerShell Bash SAP BW/4HANA

API developer

Blueprint for API Development: Standardizing Processes with FastAPI and Azure Services 11.2021 - 01.2022 Client: vattenfall

I designed a comprehensive blueprint for API development utilizing FastAPI and Azure services, which has been adopted by multiple teams within the organization. This blueprint standardizes the creation and deployment processes for APIs, thereby improving development efficiency and ensuring consistency across various projects. Tools used are Azure API Management, Azure App Services and FastAPI.

Azure API Management Azure App Services FastAPI OpenAPI Container Registry

Data Engineer

Creating a Delta Lake and Master data management platform 02.2020 - 12.2021 Client: essity

The project involved the harmonization of data to establish master data, the creation of a data lake, and the development of data pipelines utilizing Data Factory. Data processing tasks are handled using Databricks, while Azure DevOps is employed for the deployment of both pipelines and databases. Additionally, SQL Server is utilized to enhance analytics performance, providing improved integration with PowerBI. Also, managed the migration of projects from MS Azure DL1 to DL2. My role involved both development and design work, ensuring efficient data storage and access. Drove architecture decisions in close collaboration with stakeholders, shaping the roadmap and sequencing delivery to meet business goals.

Databricks Azure SQL Server Master data Data Factory Logic Apps Azure DevOps

Application Developer and Data engineer

Creating a knowledge management platform 10.2019 - 02.2020 Client: eon

Implemented a robust internal knowledge management system leveraging Django and Azure Cognitive Search, which facilitated efficient information retrieval and enhanced organizational knowledge sharing. Utilized Docker for containerization and GitLab CI/CD for streamlined deployment. Additionally, employed Bash scripting for automation tasks. Designed the application architecture in close collaboration with stakeholders, turning discovery sessions into a scalable, maintainable platform design.

Azure Cognitive Search Azure App Services Azure Batch Accounts Container Registries Docker Gitlab CI/CD Django

Employment

Senior Consultant

Promantis GmbH 04.2018 - 12.2019

Was the Senior Consultant for Data questions at Promantis. Worked only for one client - E.ON. My focus was on Data Engineering and application development. Once the data was in the Data Lake there was a need for different platforms to be created in order to make that data most accessible for internal users. Those users were Data Science teams as well as the management.

Bing Search v7 Azure App Services Azure Batch Accounts Container Registries Data Factory Docker Gitlab CI/CD Redis Tornado Flask OpenAPI Click

System developer and Architect

Cognotekt GmbH 05.2017 - 04.2018

As a senior back-end developer, I developed and maintained core applications for AI-based services in the insurance industry. My role involved writing new modules and integrating them into existing C++ applications. I also prototyped a recommender system in Python using Frequent Items Mining, contributing to improved customer recommendation strategies.

C++ PostgreSQL AWS Elastic Beanstalk AWS S3 Rencher Grafana Prometheus Logz.io Gitlab CI/CD Python

Senior Developer

Syniverse 03.2016 - 05.2017

At Syniverse, I focused on enhancing legacy code for Fraud Detection and Revenue Assurance software. I led technical efforts on a project for Roshan Telecom, using C++ and Oracle SQL/PLSQL. This project earned industry awards for its successful implementation.

C++ Oracle PL/SQL Telecommunication Linux

Systems Applications Developer

E.Solutions GmbH 03.2013 - 03.2016

I developed system applications for Audi/Volkswagen's MMI products, focusing on modules for device updates. Working in C++ on the QNX operating system, my contributions ensured the reliability and performance of software used in millions of VW group vehicles.

C++ C QNX CMake Bash

Developer and System Designer

ZIRA 10.2008 - 02.2013

At ZIRA, I worked on both rating and billing systems, developing core applications and modules. I significantly contributed to the fraud detection system, specifically the Profiling Engine, which was successfully deployed in major telecom companies.

C++ Oracle SQL PL/SQL Bash Linux

Formal Education

Diploma in Mathematics and Computer Science

University of Sarajevo, Faculty of Sciences, Department of Mathematics 2003 - 2009

High School Diploma

Gymnasium Marko Marulic, Tomislavgrad 1999 - 2003

Certificates

01.2026

Microsoft Fabric Data Engineer Associate (DP-700) Microsoft Fabric DP-700 certificate

07.2024

Databricks Certified Data Engineer Professional Databricks Certified Data Engineer Professional

Interests

Programming
Chess
Reading
Trading
Emacs