MyYearInData
  • About
  • DailyDatabricks
  • Talks
  • Mastodon
Categories
All (16)
adf (3)
AI (3)
api (1)
azure (10)
Azure DevOps (2)
Azure OpenAI (1)
Azure Web Apps (1)
ChatGPT (1)
CI/CD (1)
Commonplaces (1)
data engineering (1)
data factory (3)
database (1)
Docker (1)
Engineering (1)
Error (1)
Fabric (1)
FabricPBIP (1)
Gemini (1)
GenAI (1)
GENAI (1)
github (6)
goodnotes (1)
Greenshot (1)
iPad (1)
Large Langauge Models (1)
LLMs (1)
Mantras (1)
monitoring (1)
news (1)
Non Tech (1)
Notes (1)
OpenAI (1)
Patterns (1)
performance (1)
PowerShell (1)
prompt engineering (1)
quarto (6)
sql (2)
stashpad (1)
synapse (1)
Synapse (1)
Technology (1)
Writing (1)
Zoomit (1)

Blog

I Don’t Want My Career to DIE (So should I consider myself a Data Intelligence Engineer)?

data engineering
GenAI
AI
Engineering
prompt engineering

How your Data Engineering career can thrive in the age of AI. Learn the difference between ‘augmented coding’ and ‘vibe coding’ to avoid pitfalls and evolve into a Data Intelligence Engineer

Jun 25, 2025
Scott Bell
 

Why approximate something with AI that you can clearly define

AI
Mantras
Commonplaces
Patterns
This was generated with the help of AI based on my research. See my post on AI Content Labels
Jun 20, 2025
Scott Bell
 

Why LLM Security Isn’t Business as Usual

azure
quarto
github

LLM Security poses new risks and new challenges to an already chaotic security landscape

Jun 15, 2025
Scott Bell
 

AI Content Labels & Workflow

LLMs
Azure OpenAI
ChatGPT
OpenAI
Gemini
Large Langauge Models
AI
GENAI
Writing
Technology
Ever read something online and wondered, “Was this written by a human or AI?” It’s a fair question these days, AI slop is everywhere. As I’ve leaned more into using AI to…
Jun 1, 2025
Scott Bell
 

Fixing the Write-Host Invalid Color Error in PowerShell

Azure DevOps
PowerShell
FabricPBIP
Fabric
Error
We’ve all encountered those quirky errors that crop up like this Write-Host color error in PowerShell. If you’ve seen an error that looks something like:
Feb 3, 2025
Scott Bell
 

Creating an SSH Connection in Azure DevOps Pipelines to Azure App Service

azure
Azure DevOps
CI/CD
Azure Web Apps
quarto
github
Docker

Open an SSH Connection during an Azure Devops Pipeline deployment to Azure App Services for Advanced Configurations

Oct 25, 2024
Scott Bell

Performance Monitoring for Copy Activities in Azure Data Factory

azure
adf
data factory
synapse
performance
monitoring
In Azure data orchstration, ensuring the efficient transfer of data between systems is crucial. This is where Azure Data Factory (ADF) and Azure Synapse Analytics shine.…
Jun 18, 2023
Scott Bell
 

Copying Schemas between SQL Databases

azure
sql
database

Do you want to know how to copy Schemas between SQL Databases? What is the best way to copy data and their table definitions between SQL Databases

Apr 17, 2023
Scott Bell
 

Deploying Quarto to Azure Static Web Apps

azure
quarto
github

Learn how to install and render Quarto documents using Github Actions and Workflows

Mar 18, 2023
Scott Bell

Essential Non-Technical Tools for Data Consultants

stashpad
goodnotes
iPad
Notes
Non Tech
Greenshot
Zoomit

Essential Non-Technical Tools for technolgy Consultants that I’m currently using to help with my workflow

Feb 18, 2023
Scott Bell
 

How to install and render quarto projects with Github Workflows

azure
quarto
github

Learn how to install and render Quarto documents using Github Actions and Workflows

Jan 3, 2023
Scott Bell

Essential Non-Technical Tools for Data Consultants

azure
quarto
github

Essential Non-Technical Tools for technolgy Consultants that I’m currently using to help with my workflow

Jan 3, 2023
Scott Bell

How to deploy Quarto Blog to Azure Static Web Apps

azure
quarto
github

Learn about Quarto and how to configure your Free Azure Static Web App to deploy a blog

Dec 28, 2022
Scott Bell

Handling UK Bank Holidays in Azure Data Factory & Synapse

azure
adf
data factory
api
Synapse
Sometimes you have processes that you don’t need to run in certain scenarios. The past year I’ve been working with market trading data. Trading in exchanges happens every…
Oct 29, 2022
Scott Bell

Using Dynamic column metadata from sp_columns in ADF (to ignore calculated columns) while using copy activities

azure
adf
data factory
sql
Recently, I encountered an issue where we had to copy data from one Azure SQL database to another using Azure Data Factory (ADF) V2. The entire process was dynamic using…
Oct 24, 2022
Scott Bell
 

Back to the Data

news
Welcome back to a long overdue blog rebuild. I’ve attempted to rebuild this blog 3 times so far in the last 3 years. So finally I have finished it (if you’re reading this).
Sep 23, 2022
Scott Bell
No matching items