As I’ve noted elsewhere, I’m working on moving the JOSM plugin repository from svn to git.

I’ve managed to get something for most authors, but I am still missing attribution information for 47 authors with 95 commits between them.

If you have previously contributed to the JOSM plugin svn repository or the OSM svn repository (which used to include the JOSM plugin svn repository), please reach out to me via OSM messages or email (tsmock@meta.com, taylor.smock@kaart.com, or smocktaylor@gmail.com) if the attribution for your contributions is missing or wrong.

What I need from you:

• The name you want your patches to be attributed to
• The email you want your patches to be attributed to
  • As a reminder, this email will be publicly visible via git history. GitHub and GitLab both have noreply email addresses if privacy is a concern for you.
  • Grant Slater (firefishy) has the map used for migrating http://svn.openstreetmap.org/ to git. This will likely be used as a “last resort”; if the attribution from that conversion is OK, then no action is necessary.
• Optionally, the timezone offset for your patches (UTC±offset)

Notes on the conversion:

• patch by <foo> commits have been modified such that the originator (“<foo>”) is shown as the author, while the committer remains unchanged.
• Doesn’t do much to reduce repo size – git lfs could be used for this prior to the final conversion
• The dist directory for plugin releases has been excluded from the test repository due to size constraints
• Does not split plugins into their own repositories. This can be done later.
• plugin externals were converted to submodules; if a plugin had externals in it, those were not converted

WIP Repositories (please do not fork these; I may rebuild them at any time as I get new attribution information):

• JOSM core: https://github.com/tsmock/josm
• JOSM plugins + jmapviewer: https://github.com/tsmock/josm-osmsvn-svn2git

Earlier this month during Wikidata Data Modeling Days Hannah Bast from University of Freiburg presented QLever, a SPARQL query engine with some really cool features (slides, recording). After a month of using it, in this post I’ll discuss how it’s relevant for the OSM community and my experience so far.

What’s SPARQL and why should we care?

SPARQL is a query language for RDF data, which can come from RDF-native knowledge graphs (there are thousands of them, public and private, the best known in the OSM community is Wikidata) or other sources (for example OSM) converted in RDF with some tool or middleware

SPARQL includes an optional extension for geospatial data, geoSPARQL. Query services implementing it allow to run all kinds of spatial queries with a naming similar to other query languages based on OGC standards (like SQL on PostGIS).

One notable feature of RDF and SPARQL is that they are made from the ground-up for interoperability between different data sources (“linked data”). SPARQL natively supports querying multiple RDF data sources in one single query through “federated queries”. This works by specifying inside the query to the first service the URL of the second service and its query, then specifying how the result should be merged or joined to the data from first service. If the second service is not blacklisted, the first service will handle autonomously the communication, merge the data and return directly the final output.

QLever

QLever and osm2rdf are two projects by the University of Freiburg; they were introduced respectively in 2017 and in 2021 but only recently started getting attention in the OSM world.

osm2rdf is a tool for converting OSM data into RDF. It transforms geometries from OSM’s node-way-relation format to Well Known Text (WKT) and can indirectly materialize containment and intersection relations between elements to improve spatial querying speed. It’s FOSS and extracts of the data it generates are available online.

… See full entry

I have started an independent collection of OSM SLA statistics. Approximately once a month, I will publish my results with the aim of enhancing transparency regarding the reliability of OSM services. I use uptime-kuma to run monitoring. I also verify connectivity with non-OSM services (to prevent false positives). The current configuration includes checking the availability of openstreetmap-website and openstreetmap-cgimap (API). Tile layer availability is not currently included in the checks. The health-check resolution is set to 30 seconds, and the checks are executed from a single server in the Hetzner datacenter in Germany. For the endpoint to be marked unavailable, two consecutive checks must fail. This should be well-representative of an average user experience.

Summary

Total API downtime: 2 hours 34 minutes 13 seconds

API SLA: 99.643%

Total website downtime: 43 minutes 15 seconds

Website SLA: 99.900%

Note that some functionalities of the website require API to also be available.

Details

2023-11-30 10:07:24 - 2023-11-30 10:09:40

• Total downtime: 2 minutes 16 seconds
• 🚩 API unavailable

2023-11-30 10:16:16 - 2023-11-30 10:21:31

• Total downtime: 5 minutes 15 seconds
• 🚩 API unavailable

2023-11-30 21:34:44 - 2023-11-30 21:36:14

• Total downtime: 1 minute 30 seconds
• 🚩 API unavailable

2023-12-01 04:27:18 - 2023-12-01 04:29:00

• Total downtime: 1 minute 42 seconds
• 🚩 API unavailable

2023-12-01 17:26:20 - 2023-12-01 17:29:20

• Total downtime: 3 minutes
• 🚩 API unavailable

2023-12-01 17:45:06 - 2023-12-01 17:50:39

• Total downtime: 5 minutes 33 seconds
• 🚩 API unavailable

2023-12-01 17:50:39 - 2023-12-01 18:04:09

• Total downtime: 13 minutes 30 seconds
• 🚩 API unavailable
• 🌐 Website unavailable

2023-12-01 18:04:09 - 2023-12-01 18:06:51

• Total downtime: 2 minutes 42 seconds
• 🚩 API unavailable

2023-12-01 18:09:38 - 2023-12-01 18:10:23

• Total downtime: 45 seconds
• 🚩 API unavailable

2023-12-01 18:12:25 - 2023-12-01 18:17:09

… See full entry

The 30th of November saw the 4-year anniversary of the #osmIRL_buildings project, an ambitious project of the Irish OSM community to map all the buildings on the island. Co. Kilkenny had been the first project to be finished in the task manager in April of 2020, and I thought that it was high time to look at it again.

Since I live in that county, I had noticed missing buildings once in a while being on the road or mapping other things remotely. Relatively new (summer 2022) aerial imagery had been made available by Esri World which wasn’t as clear as Bing, but more recent.

So I decided to make a private task in the task manager and update the whole county by myself. I like to have side quests to make it more interesting, so I decided to also look for unrecorded archaeological sites. The summer of 2022 had been very dry, so crop marks would be more visible on the Esri World imagery. I wanted a private task, so nobody would map any of the tiles, and I might miss something. I usually map the bulk of the other tasks anyway, but I did not want to take any chances. This was going to be the most thorough search for crop marks and other clues to archaeological sites Kilkenny had ever seen. Or so I believe.

All in all, it took me 11 days or 75.5 hours (average time per task multiplied by tasks), but I had excluded Kilkenny city, because I usually have an eye on that all the time.

… See full entry

I started mapping by updating shop details in my area and have now moved on to helping OSMirl in completing the various tasks to get all of Ireland on the map.

I have also started adding buildings to my home city of Port Elizabeth, South Africa. The majority of the suburb (that I’ve worked on) does not have any of the houses mapped.

started to map minor roads and paths in Hahei in the Coromandel, because there sure are a lot of them. already done about 3 minor roads. not that anyone is ever going to use them other than the few locals that already do, but it’s probably got some use

As always at the end of the year comes the time for summaries and plans for the coming year. Since a great deal of my activities is related to OSM I would like to share my plans with you for the the coming year of 2024. Despite not managing to achieve everything I planned (this year, the previous year), there was still a lot going on. So let’s start with a summary of the events of the year 2023:

• I managed to conduct workshops and lectures promoting OSM in several new places, including the Wroclaw University of Technology and Adam Mickiewicz University in Poznan.
• As every year, I promoted OSM’s go at GisDay held at the University of Lodz.
• I conducted several Mapathons, supporting UN Mappers projects.
• I established cooperation with colleagues from Croatia actively supporting them in updating data, and testing the use of building data from city resources and Overture Maps.
• For the first time I took part in SotM, and I intend to participate in such events periodically.
• The OpenAedMap project has received support from CloudFerro, which has allowed us to expand the functionality of the site, and secure the platform for the future.
• The OpenAedMap.org project has gained support in the form of signing more patrons. The Center for E-Health, Warsaw University of Technology and the Medical University of Wroclaw have taken patronage of the project. I hope to expand the list of organizations supporting our initiative even further next year

Unfortunately, the list of plans that didn’t work out is much longer than I would like. This is what happens when there is not enough time or resources, and sometimes things just don’t go as intended.

… See full entry

hi!!!!!! i am new to osm and mapping in general. made my first edit/change yesterday! hopefully many more to come.

Day-20

Neis sites

• Neis sites are down for a few days.
• I started my first topic on Discourse regarding this issue. It looks like a single point of failure and actions need to be taken immediately as so many contributors use Neis’s sites and it is not even open source yet.
• This website makes the editing more fun and a game-like experience.
• Surprisingly, I have still been contributing to OSM without the country rankings or main area mapping slowly increasing.
• The last time I checked before the site went down, I was the top 6th mapper in the last two months.

Every Door

• I also learned about an app, Every Door, from my OSM Bengaluru Telegram group. We had a mapping party at Yelahanka this Saturday, but I could not join.
• I localized the Every Door map in Odia language. Let’s see when it will be released to the App.
• This App can help me maintain my 100-day streak.

Yesterday I mapped a tiny area with lots of shops, bars, etc. This stretch of 43rd is so dense and diverse, it is really interesting. There are high-end establishments, but also a church and a food bank, convenience stores, a Mediterranean market. Next survey of the west portion of 43rd I think will go quicker as it becomes more suburban.

Some highlights:

• I realized I need to add bulletin boards to my ‘look-for’ list - I found two of them in this little stretch, at a cafe and a record store.

• Did not know there was a Mediterranean market so close to my neighborhood!

• Found an interesting looking cafe I had never heard of (though it was closed at the time - will check out later)

• Random excrement bag dispenser in a residential area on the way back - it’s silly but I love finding these, like a rare item in a video game :)

I am making my way along 43rd St in Kansas City, mapping most of the amenities and businesses I see along the way. About two weeks ago, I went from where 43rd breaks off at Gilham then west to Donutology, and today I worked through the stretch between Donutology and west to the nearby QuickTrip across from the Catholic church. I did not get very far because I walked into many of the businesses and chatted with folks, so as not to be suspiciously loitering outside :D

It was really fun to explore places I wouldn’t normally think to go to. I walked into Gigi’s Health Cafe (the proprietor saw me outside and came out to say hi, so I explained what I was doing and showed her the Every Door app where I was entering her business’s info), and also Paris Banh Mi, which looks like not much on the outside, but is really quite lovely inside.

I have lots of photos that I haven’t decided where to upload yet, but that will be its own project later probably. Along with various points of interest, I started taking photos of all the light poles and street cabinets that I notice which are covered with stickers and/or graffiti. Temporary signs fascinate me. Not sure if there’s a place for photos like those on OSM but I’m keeping them for something at any rate.

On my impression of OSM as a newbie: It looks like there are not a lot of active Kansas City mappers, and that anymore, most of the updates are done by businesses or by people who create / use automated tools, and the most active people are the ones getting deeply into the technical side. A lot of the diary entries I see are about conferences and full of dense technical and/or organizational jargon. Lots of businesses and nonprofits seem to be involved.

… See full entry

I created my OSM at the beginning of 2023, on December 21, 2023 I created/updated my first map. I guess now this is for the long run.

-

Day 16

I joined OSM back in 2018. Then, there was a movement to use alternatives to Google products. For Google Maps, I found OSM.

Recently, in 2023, I finally started contributing to OSM seriously and continuously. Within around 50 days of contributions, I have already become a member of the OSM foundation and one of the top 10 mappers in India.

I am primarily focusing on:

1. Adding buildings in Bhubaneswar, my birthplace area and
2. Adding roads in Malkangiri, Odisha.

Today is Day 16 of my 100 days of OSM challenge. Let’s see where I will reach at the end of 100 days.

I have corrected alignments of buildings, shore line, roads for the area from Cherry Hill (NW) to Beaulieu (NE) down to Egmont (SE) and to the airport in the SW.

I’ve added some buildings, deleted others. Made corrections to some and added a few swimming pools. Put in a few roads, tracks, driveways and service roads. Most recently a load of solar panels at the energy company along with associated infrastructure. Fixing the St John’s River as best I could was fun. Not my first or longest and there is likely more to go.

I have reached my first goal: To make a baseline realignment for the SW of Grenada. I might give myself a little break and continue up the west coast to finish St George as the South coast it pretty congested and it will be nice to fix the whole district.

This diary is about programming, as my diaries usually are. This diary is about the code, particularly about backend codebase of the HOT Tasking Manager (TM). TL;DR of this diary is: HOT TM code is unmaintainable mess and that will not change. HOT TM developers inherited something they can do nothing about. Please, prove me wrong if you can and end up my frustration.

I will try to find out why Error when trying to split tasks happens, so deep breath and dive.

I suspect backend, so I will omit the note that it could be replicated on chrome browser only. And I will start directly at TasksActionsSplitAPI of backend/api/tasts/actions.py file, because that looks reasonable.

In the first try block I need to find out what is that SplitTaskDTO. I always forgot what “DTO” means. The import line helps and looking into backend/models/dtos/grid_dto.py says it is “DTO used to split a task”. Thanks. But the code looks like the data structure so I merely remember the purpose – just data or alike.

Only the second try left, so let’s see. The comment on the first line says it checks the project exists. I am just curious how it’s implemented, so see backend/services/project_service.py to find out exists method. Side note – I completely misunderstand classes with static methods only. Oh, exists is just Project.exists. How is that implemented? Just curious… See backend/models/postgis/project.py to see that exists is… it looks like a database query. I don’t SQLAlchemy, but note the first database request. I will number them, this one being #1.

We are back at the second try. It looks the main work is done in split_task of backend/services/grid/split_service.py, so see that (static again) method. Well, heh, not funny anymore. But I am not going to give up easily this time. So split_task now.

… See full entry

“The beauty of a tech journey lies in the shared struggles 🧩”

The quote above is a reminder that success is not a solitary path but a collective triumph over challenges. Everybody struggles 🤷🏽‍♂️. Tech’s greatest minds that we know today didn’t escape the struggle; they transformed it into the foundation of their success story. How about that?

The journey to breaking into the ever-evolving landscape of the tech industry can be challenging and daunting. From the overwhelming available knowledge to the diverse backgrounds that contribute to the beauty of the industry. You may want to grab a cup of coffee if you can, let’s quickly delve into the shared experiences that unites aspiring open source enthusiasts worldwide :)

The Struggle is Real

… See full entry

It’s wonderful to discover such beautiful and accurate mapping.

I checked my location in the Open Street Map and saw how accurate the buildings were mapped in the vicinity where I live in the province. It gave an accurate sizing of our location, which I found great.

I mentioned in my previous post about why it’s great to meet up with other mappers. One thing that someone suggested I write a diary about is the method I found to be notified about map-worthy changes to one’s local area. It turns out that not everyone has heard of the London Gazette, its role in local law and administrative changes in the UK, and the online services it offers to help discover the changes.

So here’s the Wikipedia page for the Gazette And here’s the website

The core of the publication is the notices. The rules of the road network for residential and even some of the more major roads in an area (pretty much everything that doesn’t constitute the trunk road network) are delegated to local authorities, and the ritual incantation they have to go through to change those rules is to publish notices in the local press and in the London (or Edinburgh or Belfast) Gazette.

In the navigation bar at the top of the page is a Notices menu, which will list all the most recent notices in the UK.

There are filters on the left hand side of this page where you can search for and filter the list to the particular notice type and area you’re interested in. For my local area, for things I might want to add to OSM, I’ve found that the following customisations work best:

• restricting the list to Notice Code 1501

• filtering the location by Local Authority from the drop-down box (in my case, the London Borough of Ealing)

• Hitting the “Update results” button and then changing the sort order to “Latest”.

… See full entry

I attended my second OpenStreetMap London social today. They happen approximately once every two months, but it’s been a year since my first one. It’s daunting, going to a pub in central London to meet a group of strangers, especially if you’re not the most outgoing person and your expectations are that they won’t be either. So I just wanted to recommend it. When you have a niche interest such as mapping the world for no particular return other than the vague idea that this stuff is really important and will change the world, it’s great to meet a few other people who feel the same way. Whether it consumes all your free time, or is just something you spend 15 minutes doing when you visit a new place, it’s brilliant to get perspectives from other mappers, to hear what motivates others, to see what they are doing with the data you contribute, and get some tips on things you might not have heard about. I can’t remember where I heard about the London meetup, but reminders are usually posted to the talk-gb mailing list, to the weeklyOSM newsletter, and to the OSMCal website, so do check those places out for updates.