REWRITE: warstatus.py MySQL

[Joshua2504]

I'd like to move warstatus.py to MySQL so the data is consistent with CoRT and CoR Forum.

Problem is that v2 is not made to save dynamic data in text files. The sqlite is a dirty solution.

We could run warstatus.py on cor-forum's side, making cor-forum handle the sqlite.

[Joshua2504]

@mascaldotfr got time to do this if I provide a DB?

[mascaldotfr]

On Thu, 22 Aug 2024 08:38:12 -0700 Joshua Treudler ***@***.***> wrote: @mascaldotfr got time to do this if I provide a DB? -- Reply to this email directly or view it on GitHub: #29 (comment) You are receiving this because you were mentioned. Message ID: ***@***.***>

There is nothing to do but changing the db connection code. All the rest is standardized and should require no changes.

[Joshua2504]

RegnumStarter-API is already scraping warstatus, so that implementation could be used in the future

[mascaldotfr]

@Joshua2504 what's the status on this ?

I feel motivated to try this, after all i've just to replace the json files with php endpoints. MySQL adaptation, as I said, requires minimum works. Only point of friction will be to import the sqlite file just in time in the mysql db but I can document that.

[Joshua2504]

@mascaldotfr I never started any work on this within CoRT.

I started to write a new scraper for RegnumStarter-API, which is here: https://github.com/CoR-Forum/RegnumStarter-API/blob/main/router/warstatus.js

It scrapes the official website every 30 seconds and saves fort capture events in mongodb, then posts the event in Discord.

I never continued it, and I do not plan to. Adrian worked against us and made it tricky to login without the official launcher. Meaning the RegnumStarter is totally useless and API has no use. If I continue on the Item API it will be in CoRT.

IMO it's better to have it in CoRT and use MySQL. We use MySQL here because all other services apart from API are using MySQL too (Forum, Ranking Archives, etc.).

Maybe instead of Python or PHP we can use Node?

[mascaldotfr]

I've already something running, we just have to give it some time to see how things go. I expect bugs. It's way slower than sqlite 😢

I would not totally rewrite it, the code can handle whatever tantrum thrown at us, it requires no maintenance at all. Javascript is a mess to me, it's really the most painful part of the site.

Front end is in PHP though!

[mascaldotfr]

Well, I made it run over night, it just works. I'm just waiting for a dragon wish to push a branches 👍