When writing Python code in notebooks there are a lots of packages that can be really useful to select and transform data like Pandas and PySpark. In this article you will learn how to get an overview of all the preinstalled packages and how to install new public packages from PyPi. PyPi PyPI, the Python…
Dataflows are ETL pipelines running in the Power BI Service or in a Fabric Workspace. What is the difference between Gen 1 and Gen 2 and how are they related to the normale Power Query engine inside Power BI Reports. Which new use cases wil the Gen 2 Dataflows give you in combination with a…
Spark is an important part of MS Fabric, especially if you are creating Lakehouses and want to execute Python code inside Notebooks. This code is executed by Spark Worker Nodes. This video will give you an introduction of the architecture and inner workings of this Spark Engine.
When working with databases, connecting to REST API’s or getting data from storage accounts you need username/password, API Keys or other kind of secrets. Of course you can just put them hardcoded in the Notebook and run the code and forget about them and everything works fine. But what if you connect to the same…