Open Risk Academy

Summary

In this deep dive we explore how to use the Overpass API and query language to extract OpenStreetMap geospatial data.

Content

In this deep dive course we explore the Overpass API in some detail. The topics we will cover are as follows:

1. Introducing the OpenStreetMap (OSM)
2. The OSM data model
3. Comparing the OSM geometry elements to the GeoJSON specification
4. Introducing the Overpass API
5. Setup of the Overpass Turbo Web interface
6. Overview of the OQL Language
7. Overpass API Settings
8. Overpass Query Bounding Boxes
9. Overpass QL Set Operations
10. Recursive Operations
11. Filtering for OSM Tags
12. Configuring Output Statements

Who Is This Course For

The course is useful to:

• Data Scientists / Data Engineers that want to work with OSM data

How Does The Course Help

Mastering the course content provides background knowledge towards the following activities:

• Understanding the OSM data model
• Understanding the Overpass API / DSL
• Designing effective queries to retrieve desired OSM data subsets

What Will You Get From The Course

• You will be able to confidently approach tasks involving extraction of OSM geospatial data
• You will be able to contribute to the specific use cases mentioned above

Course Level and Type

This course is part of the Data Engineering family.

• This is a Core Level course in Data Engineering, which means that good grounding at Introductory level to various data engineering topics (understanding schemas, query languages, basic data structures) is a prerequisite for making the most out of this course.
• This is a Technical course which means various technology elements (programming languages, data formats, databases) are needed as background for mastering the material.

If you have not taken an Open Risk Academy course before, the CrashCourse Academy Demo provides a quick overview of the Academy.

What is not covered

• Not a course about using OpenStreetMap (e.g., to add data) or the details of the OSM data model
• Not a course about the web interface (Overpass Turbo), except insofar as we use it for Web-based interface examples. Overpass Turbo provides and number of handy shortcuts (for example for defining a bounding box), but they are conditional on using the Web interface
• Not about the C++ code base of the Overpass API (and possible extensions or modifications)

Course Material

The course material comprises the following:

• Twelve online readings
• Embedded exercises dispersed in each section

Time Requirements and Important Dates

• The course is self-paced and can be undertaken at any point. Depending on your background knowledge and familiarity with the tools used it might require a commitment of about two days total.

Where To Get Help

If you get stuck on any issue with the course or the Academy:

• If the issue is related to the course topics / material, check in the first instance the Course Forum (Chat)
• If the issue is related the operation of the Open Risk Academy check first the Academy FAQ.
• If the issue persists contact us at info at openriskmanagement dot com

Enroll and Get Started with DAT38096

We are very happy to announce that Open Risk has joined the Digital4Sustainability Alliance Community, a European initiative dedicated to advancing the digital and sustainability skills required to accelerate the twin transition.

Digital4Sustainability (D4S) is a project funded under the EU's Erasmus+ programme. The project is dedicated to accelerating the digital and green transitions (the so-called twin transition), both within the ICT sector and across European industries. The consortium includes digital and sustainability experts, business associations, universities, and Vocational Education and Training (VET) providers from across Europe.

You can read more about the project and why we joined a the usual place.

The D4S mission goes to the heart of the sustainability transition challenges: Digital tech is essential infrastructure to help manage the information complexity of modern economies, and the sustainability transition is nothing if not complex, as it touches practically every aspect of modern society: energy systems, manufacturing, transport, land use and food systems, to name but a few. At the same time, from e-waste to the gigantic data center environmental and social impacts, the digitization of the economy has significant sustainability implications.

At Open Risk, we recognised early on that digitalisation and sustainability are deeply interconnected and we are fundamentally aligned with the objectives of the Digital4Sustainability initiative. For a long time we have been probing the possibilities of accelerated, digitally enabled learning and tools, with a particular focus in the domains of risk management and sustainable finance.

Our participation in the Alliance Community reflects our commitment to empowering Europe's workforce, fostering innovation, and contributing to a more competitive, inclusive, and sustainable continent.

We pledge to actively support the objectives of the Digital4Sustainability Alliance Community by sharing knowledge, contributing to best practice exchange, and promoting lifelong learning opportunities that address the skills needed for Europe’s twin transition.

Our participation will strengthen collaboration with peers across Europe, streamline, enhance and align our training programmes, and contribute to the collective effort of building a resilient, green, and digitally skilled workforce.

This course is a CrashProgram (short course) introducing the GeoJSON specification for the encoding of geospatial features. The course is at an introductory technical level. It requires some familiarity with data specifications such as JSON and basic knowledge of Python. The update expanded several sections, added examples with geopandas and fixed some broken links.

Enjoy!

In this course we want to study an identification framework for Open Source Business Model Risks.

The scope of the analysis covers both for-profit and non-profit projects.

The structure of the course is as follows:

• First we cover general aspects, with a focus on definitions and context.
• Next, the identification methodology sections document detailed approaches to potential weaknesses of a business model and their likely impact on the sustainability of a project.

The result is a FOSS Risk Canvas, a concise tool that helps with a comprehensive self-assessment of business model risks that can hinder FOSS projects reach financial sustainability.

In a blog post we discuss variability drivers of reported financed emissions of portfolios. Using a conceptual deed-dive into calculation procedures we isolate the fundamental factors and how they can be explained using waterfall diagrams.

The Open Risk Manual was developed for a long time, with out-most conviction, as an open and free resource. An open online repository of information about Risk Management in all its forms, that was the core idea, part of our vision for widely available open source tools for risk management and sustainable finance.

Alas, as of late the open part of the mission has become very problematic. A large number of AI bots are now roaming the internet and hitting servers (like the one on which the Manual runs) indiscriminately, without regard to breaking it. It has become very difficult to defend against such (effectively) DDoS attacks. Filtering the thousands of hostile bot requests using random address from human users is not what we want to spend our resources on. After trying all possible measures, it became clear that nothing will do. We need to ask users of the Manual to login before browsing and/or searching. 

The login mechanism is the same as the Academy. Users of the Academy can already use the Manual using their existing credentials. Other users will need to setup and have an account approved at the Academy.