How to create a plant identification app for ubuntu touch?

Moem · 7 Jun 2022, 11:11

@arubislander said in How to create a plant identification app for ubuntu touch?:

if you would embark on such a venture.

Hah! Good one. I'll just leaf you to it, and hope your endeavour will bloom and be fruitful.

s710 · 7 Jun 2022, 11:22

@arubislander said in How to create a plant identification app for ubuntu touch?:

@s710 said in How to create a plant identification app for ubuntu touch?:

But while your point is valid, it does not help much, since the alternative - implementing custom algorithms/train custom NN for image recognition - is just plain not feasible

Implementing the necessary algorithms oneself was never on the cards. I was simply pointing out that the free use was subject to restrictions. Developers know about these things, users might not. And it is not just developers that would be reading your post.

Fair enough

cliffcoggin · 6 Jul 2022, 13:36

@moem said in How to create a plant identification app for ubuntu touch?:

I'll just leaf you to it, and hope your endeavour will bloom and be fruitful.

Take that woman outside and shoot her for crimes against humour.

Emphrath · 9 Jun 2022, 14:26

I thought that was hilarious. Got another answer I wanted to share since it s outta my field of competence:

"1. Don't you think supporting Ubuntu Touch using the website is enough : https://docs.ubports.com/en/latest/appdev/webapp/index.html

the mobile app is made using React Native, unfortunately, https://github.com/status-im/react-native-desktop-qt is no longer supported but maybe there is an alternative?"

What do you think ? What should I answer ?

s710 · 6 Oct 2022, 07:51

@emphrath said in How to create a plant identification app for ubuntu touch?:

I thought that was hilarious. Got another answer I wanted to share since it s outta my field of competence:

"1. Don't you think supporting Ubuntu Touch using the website is enough : https://docs.ubports.com/en/latest/appdev/webapp/index.html

the mobile app is made using React Native, unfortunately, https://github.com/status-im/react-native-desktop-qt is no longer supported but maybe there is an alternative?"

What do you think ? What should I answer ?

Didn't get to this until now. Give me a day or two, and I will see what kind of app I can come up with. Will be a native UT app.
In case it's enough, it would be maybe worthwile offering it to them and/or asking for improved API usage agreements.

Emphrath · 10 Jun 2022, 13:37

@s710 Wow, awesome. I guess it won't be using ReactJS then ? Do you think I should let them know sth is being worked on native-wise and pass along your suggestion of extended API rights ?

s710 · 11 Jun 2022, 09:17

@emphrath said in How to create a plant identification app for ubuntu touch?:

@s710 Wow, awesome. I guess it won't be using ReactJS then ? Do you think I should let them know sth is being worked on native-wise and pass along your suggestion of extended API rights ?

Correct. I have a working prototype, which is able to pick images from your camera or gallery, and then use their API to identify it. Currently I am working on displaying the results / designing the UI for the results.
As I don't have time to work on it today, I would say by the end of tomorrow I will be able to provide screenshots of the app, which you could then send them if you want.

Basically, there are no technical issues or blockers here, its just a matter of time to get the UI nice and polished now.

s710 · 6 Nov 2022, 10:08

Teaser:

Emphrath · 11 Jun 2022, 11:25

@s710 omg that's a dream come true ^^ you're the man. Nice interior plant btw. Alright I'll let you know how and when they're willing to help.

s710 · 6 Dec 2022, 16:10

@emphrath Some more screenshots:

s710 · 6 Dec 2022, 16:12

@emphrath You can show them those screenshots if you want. The app is coming closer to being finished. The screenshots show the workflow of starting with an empty app, adding a picture for identification, receiving the result, saving the result, and then displaying the plant in the overview of already identified plants. I have omitted screenshots for selecting a picture from camera/gallery.
But I guess the order of images got messed up, I'll try to edit the post to correct the order.

Open points:

Language detection for localized identification result (plant "common names" in local language)
Automatic resizing of input images (API requires a certain max size)
Add settings page for API-Key configuration & setup instructions
Make the app icon

I guess I will be able to finish the app during next week, and publish it to the store. I can also not publish to the store and only upload to github, in case Pl@ntNet is interested in taking over the app. The app is written in maybe 50% C++ and 50% QML. Storage layer & network functionality is implemented in C++, display stuff is in QML.

Quilty weavy · 12 Jun 2022, 16:22

This post is deleted!

Quilty weavy · 6 Dec 2022, 16:38

@s710 Thanks for your effort. You can open the source code in gitlab/github to contributions for your excellent newborn application. I know a few unique species of plants and trees which I will contribute to your application for sure.

Emphrath · 12 Jun 2022, 17:37

@s710 you rock. Period. I'll submit your screenshots and questions to the team at plantnet.

Taiga Woods · 12 Jun 2022, 17:38

I would lovesuch an app! This is really one if the few things I've always missed as a UT-user. What I did is using the web-version of pl@nt.net (https://identify.plantnet.org/) and then I created an app with webber. It's slow, and I don't know what functions I am missing compared to Android and iphone. Anyway, still faster and more accurate than me identifying plants by looking it up in a book
Looking forward to a real UT solution

Emphrath · 12 Jun 2022, 17:45

@taiga-woods oh yeah, the webber solution was also the cross I had to bear ^^

s710 · 12 Jun 2022, 18:13

Thanks guys for the feedback.

Please keep in mind that I’m basically just implementing what was said in the initial post. This means that I’m no Pl@ntNet user, and I don’t know their iPhone app and their other features.
Looking at what the my.pl@ntnet API seems to expose, this especially means it will not be possible to submit own categorisations. IF their API allows it, of course I’m gonna happily add it to my app. But upon first look, it only allows to identify plants by pictures.

Also, the UT user will have to sign up as developer in order to get a key, which is needed to use the API. But let’s see what @emphrath can negotiate Thanks for doing the communication.

Quilty weavy · 13 Jun 2022, 12:27

@s710 If what you are saying is true then try opening your half-developed application on github for contributions. These contributions might solve any of the issues you are struggling to fix. Even I will try looking into it.

s710 · 13 Jun 2022, 13:06

@quilty-weavy There are no issues I am struggling with. It all depends on what the service of Pl@ntNet is offering. And this can only be influenced by Pl@ntNet, and not by external app developers (me).

As per https://my.plantnet.org/usage, their service only allows to submit images to get a plant identification back.
There is no feature in their public service which allows to submit own identifications back to Pl@ntNet.

As stated on the linked website, one should use their official apps (iPhone, Android) instead to contribute and submit identifications. Of course this means that there must be a service to submit own identifications somewhere, but it is just not available to the publicity / external app developers.

As @Emphrath is already in contact with Pl@ntNet, and they seem to be aware of us making an app for UT, and they know that no offical apps for UT exist, maybe they will be opening the service to submit identifications to me/us, so I can integrate it into the app. But thats completely out of our hands.

Hope I explained it well enough.

Emphrath · 13 Jun 2022, 15:01

@s710 hey there ! They said: "maybe we can increase the quota to sth later on when the app is finished" this is encouraging. They also are asking for the repo - could you provide that ?