Data Driven

In this keynote from the Azure Data Fest 2018 in Reston, Tim McAliley and Devin Jaswal explore the data services available in Azure.

In this Data Point, Frank and Andy talk about reinforcement learning, Mario Brothers, and then get sidetracked. Then Joel Cochran stops by and they really get sidetracked.

In this episode, Frank and Andy talk with Rie Irish about her path from sociology to database administration, women in technology, and getting people to walk around in circles.

We love experimenting around here and examining the resulting data. After all, we are Data Driven: not just in name but also in spirit. In this webinar Andy recorded, he also streamed it live on our Facebook page. We thought it was good enough to share with our larger audience here. Let us know what you think. Both Frank and Andy have been recording/streaming their live events and we’re curious to hear what you have to say about this innovation in how we podcast.

Andy is at SQL Saturday Boston and he runs into another Andy from SentryOne.

Today, Frank was in Philadelphia presenting a session at AI Discovery Day on Computer Vision Cognitive Services. The labs for this session are on GitHub: https://github.com/Azure/LearnAI-Bootcamp/tree/master/lab01.1-computer_vision These events will be taking place across the US. Here are a few dates and links to registration. City Date Title Link Boston, MA 9/28/2018 AI Discovery Day Registration Link Boston, MA 10/16/2018 AI Discovery Day Registration Link Malvern, PA 10/17/2018 AI Discovery Day Registration Link Reston, VA 10/25/2018 AI Discovery Day Registration Link Boston, MA 10/25/2018 WORKSHOP: Applied AI – Cognitive Services Registration Link

Hurricane #Florence has been making its presence known on the eastern shores of the mid-Atlantic region since the wee hours of this morning (13 Sep 2018). In Farmville, Andy is seeing weather that is being pushed by the storm – not the storm itself. Update: Andy blogged about the @AndyWeather weather station and how he uses IoT technology to tweet weather data and display it at AndyWeather.com. In other news, this is Episode #150 and we hit 70,000 downloads earlier today. Thank you listeners! Thank you guests! Yall rock!

In this DataPoint, Andy shares plans to capture weather data from Hurricane Florence for a site he maintains – named AndyWeather – and a Twitter account named @AndyWeather.

In this episode, Frank and Andy chat with Stu Ainsworth about service reliability in a chaotic world. Links Sponsor: Audible.com – Get a free audio book when you sign up for a free trial! Notable Quotes Postmortem: VSTS 4 September 2018 ([02:00]) Stuart Ainsworth on Twitter: @CodeGumbo ([05:30]) Reliability: Expectations vs. Solutions ([06:00]) “Canada is another country.” ([11:00]) “Serendipitous” ([11:55]) TV references: MacGyver and The A-Team ([13:40]) Chaos Monkey ([00:00]) Brent‘s book review of Database Reliability Engineering ([15:00]) Andy cannot count 9’s… ([19:15]) The shifting node for “big data.” ([23:30]) Service Level Objective ([25:00]) The Black Swan (Audible) by Nassim Nicholas Taleb (@nntaleb) ([28:00]) Frank’s 9/11 Experience ([30:00]) Culture is prime. ([35:00]) The hard part is figuring out, “What is the problem we’re trying to solve?” ([35:45]) DTU ([36:50]) Things are changing. Some folks are threatened ([40:30]) Stu works for Jack Henry. ([41:40]) Risk cannot be removed by technology. ([43:30]) “… it’s kinda like an old girlfriend…” – Stuart Ainsworth ([44:30]) Road trips! ([47:30]) “We are living in interesting times.” ([49:00]) Hoschton, Georgia ([50:25]) Stu likes the book Accelerate ([52:40]) Find out more about Stu at CodeGumbo.com! ([53:45]) Learn more about Azure DataFest by following @AzureDataFest on Twitter! ([54:00])

On Friday, the first ever Azure AI Fest was held in Reston, VA. Data Driven streamed the keynote presentation live and was a sponsor. So, enjoy the audio of the keynote address by Ashish Jaiman, a former colleague and manager, who now works in the Democracy and Cybersecurity team at Microsoft. If you prefer to watch the event, including some of our special effects laden pre-roll, then click on the play icon below. Jump to the ten minute mark to see the event.

In this episode, Frank and Andy talk to Jake Mannix, an accomplished data engineer who has had an amazing career. Links Sponsor: Audible.com – Get a free audio book when you sign up for a free trial! Notable Quotes Frank heartily recommends Head Strong ([00:50]) It takes a lot of time to fly from Farmville to India… ([2:40]) Audible is a sponsor! ([04:00]) Jake is a Chief Data Engineer for LucidWorks ([06:15]) Jake describes a cool Systems Development Cycle… ([10:00]) … and compares and contrasts with Customer Service and Product Engineering. ([12:00]) Sometimes this cycle works “too good!” ([13:10]) Learn more about Lucene. ([15:00]) We now search by typing questions. Not terms. ([15:40]) More about Query-Intent Classification… ([17:10]) “How Do I Do Brain Surgery” – Google Search ([18:25]) Smart search is based on closed loop analysis of “who clicks on what.” ([19:30]) One example of public search datasets: Google Trends. ([21:30]) What is a garage-door opener? ([22:00]) “We expect a lot from search these days.” ([26:10]) Searching Amazon for garage door. ([26:40]) “Data is their foundation.” ([28:00]) “I’m a data engineer.” ([31:00]) “Math is fun but it’s 5% of the work.” What is most of the work? Data cleansing. ([31:20]) On tensors… ([31:40]) Jake likes to run long distances over mountains! ([33:10]) Jake thinks self-driving cars will be cool. ([37:30]) Jake shares his encounter with the Moonies, which wins the Something Different About Yourself segment (to date). ([39:35]) Jake and his daughter like to listen to audio books. ([43:20]) Learn more about Jake on LinkedIn! ([44:00]) Jak helped build LinkedIn‘s search engine! ([44:44]) Check out the LucidWorks blog. ([45:00])

If you’ve not heard the news, the first ever Azure AI Fest is happening Reston this Friday and we are super excited to announce that Data Driven will be the official media sponsor. As such, we’ll be live streaming the keynote on our Faceook page.

While on the drive back from the inaugural Azure Data Fest Atlanta, Andy pauses and reflects on what it takes to get into Data Science, AI, and Data Engineering in 2018.

Andy is at the inaugural Atlanta Azure Data Fest and, while talking to organizer Stu Ainsworth, a who’s who of Atlanta SQL community folks, including former guest Julie Smith, drop by and say hello.

Andy is presenting at the Atlanta Azure Data Fest and he bumped into former guest, Joel Cochran.

In this episode of Data Driven, Frank and Andy talk with Micheleen Harris, an R developer who loves Python. Yes, it is possible. Show notes coming soon!

In this episode of Data Driven, Frank and Andy answer two questions sent in by listeners.

Yesterday, I had the chance to speak to a group of high school students from around the world who enrolled in a data and coding focused summer program at Georgetown University. It was a great experience and underscores the need to teach kids the importance of data as well as coding.

Recently, this post of the Best Jobs in the US came across my news feed. Note that “Data Scientist” has been knocked out of first place by “Machine Learning Engineer.” This title didn’t even exist a few years ago. So then, how do we prepare kids for the future of work when the jobs don’t exist yet. Simple: you prepare them with the fundamentals. As I recorded this show, I was joined by a distinguished guest rather by surprise. See, anything can happen on a live stream! Check out his coding camp’s website at http://fairhavencodingcamp.com and if you live in the DC area, sign up your middle/high schooler today!    

While in Vegas, I caught up with my former DataLeader pal, Kim Schmidt to talk about her new book, advanced analytics, and why Microsoft, Google, and Amazon are the Ford, GM, and Chrysler of the 21st century.

In this Data Point, Frank talks about how it’s data analytics and statistical analysis — and not luck — that run Las Vegas. It’s not Sin City, it’s Stats City. Although, that’s not nearly as catchy.

Frank and Andy sync up before a big internal conference and some goodies that Andy’s working on.

In the first episode of “Season 2,” Frank and Andy catch up with Joel Cochran. Joel Cochran leverages data in the political arena. Show notes coming soon.

Links Sponsor: Audible.com – Get a free audio book when you sign up for a free trial! Sponsor: Enterprise Data & Analytics McKnight Consulting Group Notable Quotes On strategy and leadership… ([7:00]) “Business strategy is really about data strategy” ([7:45]) It takes a team ([10:30]) On AI: “We’re only barely tapping into the possibilities…” ([12:00]) Interviewing at IBM ([12:45]) “…data as its own discipline, it’s not a drag-along to applications.” ([14:45]) William is active! ([16:00]) AI is the coolest thing ([17:30]) Growing meat, prescription errors ([19:00]) On McKnight Consulting Group ([21:20]) @WilliamMcKnight “Be a leader.” ([25:50])

In this Data Point, Frank reflects on the impact of data analytics on cancer research and one year of recording data points. In honor of Father’s Day, he left a few bloopers in place.

Summer vacation season is upon on us(at least in the Northern Hemisphere) and Andy is taking some well-deserved R&R at Busch Gardens in Virginia. However, data never takes a vacation and he notices something new at the Loch Ness Monster ride.

It was two years ago today that I had what I refer to now as my “Blues Brothers moment.” If you’re not familiar with the movie, then this GIF below depicts the seen elegantly enough. via GIPHY As promised, here’s the live stream I did from the hotel after day one. I’d like to think my on camera presence has improved since then. Also here are the links to the two videos I recorded in the Channel 9 Studios: Decoding Brainwaves with Azure Machine Learning Getting Started with the Brainwave Decoding Competition

In this episode, Frank and Andy celebrate one year of podcasting, the origins of “Data Points,” how the show got started, and where it may be headed.

Varigance is poised to release the 2018 version of their toolset: BimlExpress, BimlStudio, and BimlFlex. BimlHero Andy Leonard has an update!

Frank and Andy are in the same place for the first time in a while and they have a special announcement: the show has reached 50,000 downloads in just under one year. Thank you for supporting the show. You rock!

Frank caught up with Karen Lopez at the Philly Azure Data Fest to talk rocket science, data, and the perils of developers misusing columns in the schema. We also uncover the meaning of DBA (Don’t Bother Asking) and a super secret flag to make your databases run faster. (Not really)

At the Philly Azure Data Fest, Frank sits down with Tim McAliley to find out where Azure Data Fest started and where it’s headed to next,

Frank and Andy are out and about and if they can’t be in the studio, they are going to bring the studio to where they are in order to keep you up to date on all the data happenings out there. In this Data Point, Frank is at the Philadephia Azure Data Fest to listen, learn, and record. He also talks about the recent announcements from the Microsoft Build conference earlier this week.

… and Andy’s delivering training! From Frank and Andy at Data Driven: “For those about to teach, WE SALUTE YOU!” Happy Teacher Appreciation Day, teachers! You rock! :{>

Andy ran into Kathi Kellenberger at SQL Saturday Albuquerque to talk about her career change, Breaking Bad, and loving your job.

Andy ran into Jason Brimhall, certified Data Master, about high volume transactions, big data, and how DBAs fit into the Data Science picture.

Andy speaks with Meagan Longoria about the importance of creating accessible reports in PowerBI, SQL Pass and more.

Andy may not be the one who knocks, but he is in Albuquerque for SQL Saturday. He runs into DBA extraordinaire as to how DBAs fit into the Data Science ecosystem and why they say no to developers so often. via GIPHY

With Andy travelling around and Frank starting a new job, Frank and Andy have not had a lot of studio time lately. So, they are bringing the studio to you by creating more Data Point shows, which bring you some of the brightest minds they run into out in “the wilds of Data Science” as well as their thoughts and insights on the spot wherever they go. Where possible, Frank uses his ninja editing skills to filter out background noise and make the listening experience as pleasurable as it is educational.

A few years ago, Andy collected local weather data from his farm near Farmville Virginia and posted it online. Why? To see if he could. Even though the old weather station ceased working years ago, he still uses the data in SSIS training courses he delivers. It was time for a new weather station, so Andy picked up this Acurite model. He plans to use it to conduct data science and data engineering experiments. Why? To see if he could. To get things started, Andy set up the Acurite software to append readings to a CSV file every 12 minutes. He then grabbed a copy of the AzCopy command-line utility Andy decided to run the Acurite software and AzCopy on a very old Windows 7 machine (with only 2GB RAM). Why? To see if he could. It works. Andy built a command line for AzCopy that performs a data transfer from the old Win7 machine to Azure Blob Storage. He then used Task Scheduler to fire the command line every 15 minutes… and you already know why. :{>

In this DataPoint, Frank talks about the term “Data Estate” in front of an actual estate.

Andy is suffering from seasonal allergies but the allergy meter says pollen is low. What gives? Outliers. That’s what. Here’s the bar chart to which Andy refers: Here’s a pollen heat map:

After attending the Global Azure Bootcamp with my son, I decided to drop in and see what bargains there were at the nearby Toys R Us. I have fond memories of going to Toys R Us when I was a kid. However, I’ve noticed a distinct decline in the store over the last few years. Given the state of their business, I know I am not the only one to see this once great retailer fall from grace. It was a weird feeling walking through a store I had fond memories of and picking through its carcass like a vulture feasting on roadkill. Naturally, the pundits will point the blame of Toys R Us at Amazon, but is that fair? Is it accurate? Well, kind of. Jeff Bezos recently talked about his “one character” emails that forwards to his senior managers when he fields a complaint from the public. These emails not only strike fear into the hearts of the most senior executives at the online retailer, they also spur these leaders to act immediately to resolve the customer issues. What killed Toys R Us wasn’t Amazon: it was Amazon’s relentless commitment to customer service against large retailers who’ve grown lazy and content. Now that consumers have a choice, they will choose to do business with those companies that provide the best customer experience. Ok, But How Does Data Fit into this? It does indirectly. From the article: [emphasis added] So those customer complaints gives him front-line insights. If all of his data say one thing and a few customers say something else, he believes the customers. “The thing I have noticed is when the anecdotes and the data disagree, the anecdotes are usually right. There’s something wrong with the way you are measuring it,” he explained. Naturally, as a data professional, those two phrases caught my attention. In fact, I see this as a failing in more than one enterprise: the assumption that the BI dashboard knows all. It might, but it very well may not. If the data tells a different story from what’s going on in the field, then is the field wrong or is the data incomplete? Put another way: If the map says that there’s a road and there is no road, is the map wrong or is reality wrong? Clearly, reality is the ultimate arbiter and if you’re business is retail, then your reality is customer perception, not what the pretty graphics on your KPIs say.

In this DataPoint, Frank talk to Brian Moran about Global Azure Bootcamp, Databricks, AI, and life at Microsoft. As this is Mr. Moran’s third appearance, this makes him Data Driven’s first ever threepeat guest.  

Recently, I delivered a presentation on “Data Science for the Curious” at the WeWork K Street location in Washington, DC. The goal was to help the largely non-technical audience of public policy professionals understand some of the core tenets of data science: its promises and its perils. In light of the recent Facebook revelations, this is more critical now than ever before.

Frank ponders weather prediction models, the confusion matrix, and cognitive biases.

While at SQL Saturday Chicago, Andy gets recursive by talking to Andy. Seriously, he meets up with Andy Yun, one of the organizers of SQL Saturday Chicago.

Straight from the Windy City SQL Saturday, Andy chats with Cathrine Wilhelmsen to dicusss all things BIML, matching shirts, and data.

Andy’s in the Windy City on this St. Patrick’s Day attending SQL Saturday and he bumps into Bill Wolf.

In this Deep Dive, Frank and Andy delve into the depths of Data Integration and SQL Server Integration Service.