Data | Towards Data Science https://towardsdatascience.com/tag/data/ Publish AI, ML & data-science insights to a global community of data professionals. Tue, 15 Jul 2025 05:10:42 +0000 en-US hourly 1 https://wordpress.org/?v=6.8.1 https://towardsdatascience.com/wp-content/uploads/2025/02/cropped-Favicon-32x32.png Data | Towards Data Science https://towardsdatascience.com/tag/data/ 32 32 What Can the History of Data Tell Us About the Future of AI? https://towardsdatascience.com/a-brief-recent-history-of-data/ Tue, 15 Jul 2025 05:10:24 +0000 https://towardsdatascience.com/?p=606585 A 40-Year Look at Data, Business Models, and the Forces Shaping Intelligent Systems

The post What Can the History of Data Tell Us About the Future of AI? appeared first on Towards Data Science.

]]> Parquet File Format – Everything You Need to Know! https://towardsdatascience.com/parquet-file-format-everything-you-need-to-know/ Wed, 14 May 2025 18:48:02 +0000 https://towardsdatascience.com/?p=606014 New data flavors require new ways for storing it! Learn everything you need to know about the Parquet file format

The post Parquet File Format – Everything You Need to Know! appeared first on Towards Data Science.

]]> Stop Creating Bad DAGs – Optimize Your Airflow Environment By Improving Your Python Code https://towardsdatascience.com/stop-creating-bad-dags-optimize-your-airflow-environment-by-improving-your-python-code-146fcf4d27f7/ Thu, 30 Jan 2025 20:31:57 +0000 https://towardsdatascience.com/stop-creating-bad-dags-optimize-your-airflow-environment-by-improving-your-python-code-146fcf4d27f7/ Valuable tips to reduce your DAGs' parse time and save resources.

The post Stop Creating Bad DAGs – Optimize Your Airflow Environment By Improving Your Python Code appeared first on Towards Data Science.

]]> Basics of Probability Notations https://towardsdatascience.com/basics-of-probability-notations-03b6abd5510a/ Mon, 27 Jan 2025 22:33:15 +0000 https://towardsdatascience.com/basics-of-probability-notations-03b6abd5510a/ Union, Intersection, Independence, Disjoint, Complement: Advanced Probability for Data Science Series (1)

The post Basics of Probability Notations appeared first on Towards Data Science.

]]> All The SQL a Data Scientist Needs to Know https://towardsdatascience.com/all-the-sql-a-data-scientist-needs-to-know-7a5328176a67/ Tue, 07 Jan 2025 18:34:49 +0000 https://towardsdatascience.com/all-the-sql-a-data-scientist-needs-to-know-7a5328176a67/ What you need to know, best practices, and where you can practice your skills

The post All The SQL a Data Scientist Needs to Know appeared first on Towards Data Science.

]]> In Defense of Statistical Significance https://towardsdatascience.com/in-defense-of-statistical-significance-996e8c62f3e8/ Mon, 06 Jan 2025 21:54:10 +0000 https://towardsdatascience.com/in-defense-of-statistical-significance-996e8c62f3e8/ We have to draw the line somewhere

The post In Defense of Statistical Significance appeared first on Towards Data Science.

]]> Data behind the Luck, Ambition, and a Billion-Dollar Dream: Lottery https://towardsdatascience.com/the-lottery-data-behind-the-luck-ambition-and-a-billion-dollar-dream-c31fdc17d170/ Sat, 04 Jan 2025 04:44:29 +0000 https://towardsdatascience.com/the-lottery-data-behind-the-luck-ambition-and-a-billion-dollar-dream-c31fdc17d170/ Using Seattle's local retail store data for consumer patterns of the lottery (SQL, Python)

The post Data behind the Luck, Ambition, and a Billion-Dollar Dream: Lottery appeared first on Towards Data Science.

]]> Chi-Squared Test: Comparing Variations Through Soccer https://towardsdatascience.com/chi-squared-test-comparing-variations-through-soccer-e291ffe22c2f/ Wed, 01 Jan 2025 00:41:55 +0000 https://towardsdatascience.com/chi-squared-test-comparing-variations-through-soccer-e291ffe22c2f/ Understanding Different Types of Chi-Squared Tests: A/B Testing for Data Science Series (8)

The post Chi-Squared Test: Comparing Variations Through Soccer appeared first on Towards Data Science.

]]> Bayes’ Theorem: Understanding Business Outcomes with Evidence https://towardsdatascience.com/bayes-theorem-understanding-outcomes-with-evidence-9e23e18b0912/ Thu, 12 Dec 2024 23:40:16 +0000 https://towardsdatascience.com/bayes-theorem-understanding-outcomes-with-evidence-9e23e18b0912/ A practical introduction to Bayes' Theorem: Probability for Data Science Series (2)

The post Bayes’ Theorem: Understanding Business Outcomes with Evidence appeared first on Towards Data Science.

]]> Data Valuation – A Concise Overview https://towardsdatascience.com/data-valuation-a-concise-overview-72e8cf12c755/ Thu, 12 Dec 2024 14:09:15 +0000 https://towardsdatascience.com/data-valuation-a-concise-overview-72e8cf12c755/ ChatGPT and similar LLMs were trained on insane amounts of data. OpenAI and Co. scraped the internet, collecting books, articles, and...

The post Data Valuation – A Concise Overview appeared first on Towards Data Science.

]]> Probability Distributions: Poisson vs. Binomial Distribution https://towardsdatascience.com/probability-distributions-poisson-vs-binomial-distribution-ff8a6ddeb4a1/ Tue, 10 Dec 2024 05:40:41 +0000 https://towardsdatascience.com/probability-distributions-poisson-vs-binomial-distribution-ff8a6ddeb4a1/ Using Soccer to Understand the Difference Between Poisson & Binomial: Probability for Data Science Series (3)

The post Probability Distributions: Poisson vs. Binomial Distribution appeared first on Towards Data Science.

]]> Your Data Quality Checks Are Worth Less (Than You Think) https://towardsdatascience.com/your-data-quality-checks-are-worth-less-than-you-think-c8bd181a1327/ Wed, 20 Nov 2024 18:04:28 +0000 https://towardsdatascience.com/your-data-quality-checks-are-worth-less-than-you-think-c8bd181a1327/ How to deliver outsized value on your data quality program

The post Your Data Quality Checks Are Worth Less (Than You Think) appeared first on Towards Data Science.

]]> ROI Worship Can Be Bad For Business https://towardsdatascience.com/roi-worship-can-be-bad-for-business-1c752fca3896/ Fri, 15 Nov 2024 17:56:56 +0000 https://towardsdatascience.com/roi-worship-can-be-bad-for-business-1c752fca3896/ Watch out for these three ways too much of a good thing can be dangerous

The post ROI Worship Can Be Bad For Business appeared first on Towards Data Science.

]]> How to Create a Network Chart in Tableau https://towardsdatascience.com/how-to-create-a-network-chart-in-tableau-145563ec3861/ Tue, 05 Nov 2024 19:41:00 +0000 https://towardsdatascience.com/how-to-create-a-network-chart-in-tableau-145563ec3861/ A Step-by-Step Guide to Network Visualization in Tableau

The post How to Create a Network Chart in Tableau appeared first on Towards Data Science.

]]> Efficient Testing of ETL Pipelines with Python https://towardsdatascience.com/efficient-testing-of-etl-pipelines-with-python-f4373ed5a5ff/ Thu, 03 Oct 2024 09:39:04 +0000 https://towardsdatascience.com/efficient-testing-of-etl-pipelines-with-python-f4373ed5a5ff/ How to Instantly Detect Data Quality Issues and Identify their Causes

The post Efficient Testing of ETL Pipelines with Python appeared first on Towards Data Science.

]]> TSV in Pandas: A How-To Guide https://towardsdatascience.com/tsv-in-pandas-a-how-to-guide-1854b4b86c7f/ Tue, 01 Oct 2024 17:47:52 +0000 https://towardsdatascience.com/tsv-in-pandas-a-how-to-guide-1854b4b86c7f/ The Correct Way of Loading and Writing TSV Files with Pandas

The post TSV in Pandas: A How-To Guide appeared first on Towards Data Science.

]]> What Makes a Great Data Business https://towardsdatascience.com/data-business-evaluation-9171fb3aa90d/ Mon, 16 Sep 2024 17:02:34 +0000 https://towardsdatascience.com/data-business-evaluation-9171fb3aa90d/ Including an easy-to-use data business evaluation cheat sheet

The post What Makes a Great Data Business appeared first on Towards Data Science.

]]> The Forgotten Guiding Role of Data Modelling https://towardsdatascience.com/the-forgotten-guiding-role-of-data-modelling-a76f69364284/ Wed, 21 Aug 2024 20:11:06 +0000 https://towardsdatascience.com/the-forgotten-guiding-role-of-data-modelling-a76f69364284/ Getting to the bottom of what structuring your data responsibly really means

The post The Forgotten Guiding Role of Data Modelling appeared first on Towards Data Science.

]]> Improving Code Quality During Data Transformation with Polars https://towardsdatascience.com/improving-code-quality-during-data-transformation-with-polars-92997e67c8a9/ Fri, 09 Aug 2024 19:19:20 +0000 https://towardsdatascience.com/improving-code-quality-during-data-transformation-with-polars-92997e67c8a9/ Optimize your data workflows with Polars by improving code quality and refining transformations with these best practices.

The post Improving Code Quality During Data Transformation with Polars appeared first on Towards Data Science.

]]> Spatial Interpolation in Python https://towardsdatascience.com/spatial-interpolation-in-python-0864abca6d48/ Thu, 08 Aug 2024 08:49:01 +0000 https://towardsdatascience.com/spatial-interpolation-in-python-0864abca6d48/ Using the Inverse Distance Weighting method to infer missing spatial data

The post Spatial Interpolation in Python appeared first on Towards Data Science.

]]>