Python

Is Rainfall Getting Heavier? Building a Weather Forecasting Pipeline with Singapore Weather Station Data

Using data-driven approaches for weather forecasting in the tropics
How many seasons does a tropical country like Singapore have? Is global warming real, and is rainfall getting heavier?  To answer these questions, I will show how we could use Requests and Pandas to build a data pipeline that extracts Singapore weather station data for a user-defined time period and explore the weather trends and seasons over the past few years.
Most of the world experience the four seasons, but how many seasons does a tropical country like Singapore have? Is rainfall getting heavier? We can get such insights from publicly-available weather data; however, we need to write scripts to make API requests to retrieve the data. In this talk, I will be sharing about my approach in building a data pipeline that extracts Singapore weather station data from Data.gov.sg APIs for a user-defined time period using pandas. Based on the extracted data, I will also be using a data-driven approach to gain a better understanding on the weather trends and seasons over the past few years, and explore different approaches in forecasting future weather trends based on these insights.

Additional information

Type devroom

More sessions

2/7/21
Python
D.python
We will talk about different approaches in teaching Data Science with the Python programming language. As a case study, we will use our own experience in providing Data Science education with Python across different audiences in the Asia Pacific region and share approaches and principles that worked for us. The lecture will serve as an anchor for more conversations and discussions for adapting pedagogy that is most effective for various contexts and settings.
2/7/21
Python
D.python
In 2020, with funding from Mozilla and CZI, the pip packaging team improved pip for all users. These focused on improving the depedenecy resolution for Python packages, and the user experience for all Python users. We carried out usability testing, user research and improved error and information messages for pip. This talk will be about these improvements - we'll explain how the new dependency resolver works, what it can (and can't do!), how we improved the user experience of pip, the ...
2/7/21
Python
D.python
Mypy has been around since 2012, and in recent years its gaining wide spread adoption. As the framework continues to evolve and improve, more and more useful features are being added. In this talk I'm presenting some hidden gems in the type system you can use to make your code better and safer!
2/7/21
Python
D.python
We made the Web accessible to human. What about making the web (of data) accessible to computers? Publish open data could be struggling. Deposit a CSV file on a web server is not enough. The data model used should be explicitly defined. The Linked Open Data (https://www.w3.org/standards/semanticweb/data) solves this with: * standardized implementation format (RDF) * standardized data access (Content negociation, SPARQL endpoint) * standardized data indentification (URI, data model as data) For ...
2/7/21
Python
D.python
Everybody hates mundane tasks, they are boring, repetitive and time-consuming. That’s why I love building bots, they can finish my tasks for me by working 24/7. But to build a bot to interact with the users, you have to write in async. If you are afraid of async, don’t worry! Today I am telling you how I learn using async and how I avoid checking in 500+ people in a conference by building a bot with Discord.py.
2/7/21
Python
D.python
As part of the schul-frei project of Teckids e.V. we curate free software and offer it to educational institutions. Besides the general equipment of schools with free software, an equal involvement of students in the development is for us important. One of the solutions presented by the project schul-frei is AlekSIS, a web-based school information system that is being developed jointly by Teckids e.V. and students of the Katharineum in Lübeck. The django-based platform provides data structures ...
2/7/21
Python
D.python
Pinax is an open-source ecosystem of reusable Django starter projects, apps, and themes for building websites. When developers began building Pinax in 2007, they had fun adding to it, but eventually Pinax had grown to become around 80 projects and apps. Without a strategy in place to make Pinax as easy as possible to maintain, the maintainers began to suffer burnout. I was hired to work on Pinax in the fall of 2017. In my talk, I'll outline the critical problems I've discovered and the solutions ...