Skip to main content

Loading Folders as Data Sources in POWER BI

 

Power BI can connect to a plethora of different data sources.  Did you know Power BI can also make loading multiple files at one time a cinch?  There is an option from the Get Data icon for “Folder”.  Wait, a folder is not a data source, is it?  Well, all the files in that folder are for sure data sources.

So what makes the “Folder” option something you need to know about?  Do you get new files with the same column structure sent to you on a set time frame and then have to go and append them to your existing file?  Have you ever found yourself appending multiple files over and over that have the same column structure?  If you answered yes to any of those last 2 questions, then you are going to fall in love with the “Folder” data source.

Simply put, the “Folder” option allows you to bring in all of your files at once into Power BI.  You will then make all of your transforms on one sample file and Power BI will automate the process across all the files of your choosing and append the files into one query.  Do you remember the phrase “Set it and forget it!” from those infomercials about the Showtime Rotisserie back in the 90's?  Well that’s exactly what the “Folder” option allows you to do.  You can set it and forget it 😉

In my demonstration, I show how to set up the folder option, how to filter out the files you want to load, and a best practice about duplicated records that I address at the end of the video.


Labels:

Comments

  1. James ZicrovMay 18, 2021 at 10:35 AM

    I think SOAP API and REST API are amongst the best tools to provide solutions to complex IT problems.


    Powerbi Read Rest

    ReplyDelete

Post a Comment

Popular posts from this blog

Best Practice To Trim Before Removing Duplicates or Merging In Power Query Editor

In last week’s blog, I wrote and did a video about how to remove duplicate records and keep the most recent entry as long as a date column was part of the data source.   I came across the scenario while giving training on Power BI with my company Pragmatic Works.   See the video below:     This week, while doing another two-day training I came across a different scenario from a follow-up conversation from day 1.   I had explained how to remove duplicate records and one of the students started working on a Power BI project she has for her company.   On day 2 the student informed me that her remove duplicates step was not working.   I said that is odd and I asked to see the data.   In one of her table visuals, I could see that it appeared that a few of the records had duplicates based on the name column.   After further investigation though, we figured out the culprit.     She had done all the steps correctly, but it was a data integrity issue.   In her data source, the perso
Post a Comment
Read more

The Power of CALCULATE in Power BI

Last week in my blog and video I discussed how Power BI could have made my life as a teacher much easier.  It is not that Power BI can do things that I could not on my own.  It is the fact that Power BI could have saved me so much time.   This led me to some thoughts and questions.   How could I have impacted the students more in the classroom with this extra time?  Would teachers who were not analyzing student data due to time constraints now start?  How can I make the data tell my students a story that gives them an accurate picture of their progress?   That last question is what leads to this week’s blog.   Many times the metrics (which is just a fancy word for "numbers") of what we want to show are easy to do by hand with a basic math background.  Although easy, it can be very time consuming when dealing with different groups of data: like 6 periods of students instead of 1 period. When we want to do these calculations quickly with minimal effort in Power BI it is not
7 comments
Read more

Relating "Related Tables" to Baseball because I Miss Sports

I miss sports. In particular, I miss baseball. Between learning more Power BI functions and the ins-and-outs of DAX, I've turned to Netflix to fill the deep caverns left in my soul since baseball season has been postponed. And as a result, I've thought more about tigers and big cats more than I ever have in my life. I know ALL about Carol Baskins and am fully on board for a spin-off centering on locating her lost husband. I've googled "is it really legal to own a tiger in a residential area?" Without baseball in April, I am barely hanging in there (kinda like Joe Exotic's eyebrow ring). So, I am filling the sports-sized hole by using baseball stats in Power BI to demonstrate pulling data from multiple tables and consolidating it into one table.  Some of the data we want to consolidate also has to have some aggregations (which is fancy for "calculations") performed on it.  In this demo I will attempt to break down what is really going on
Post a Comment
Read more