A quick how-to on getting offline maps for Unav.

Recently i needed to update my offline map and everytime it's quit a mess to setup an OpenstreetMap local server, lost of hours lost on that. I recently found a docker instance perfect for our needs.

What we need in this how-to

• A linux computer (of-course) with disk space
• Snap of Jtiledownloader installed
• docker.io installed

Optional

• A nextcloud instance
• desktop nextcloud sync software
• Ubsync.

First of all : setting up tile server.

Not much to say, except follow the work of this great Github repository :
https://github.com/Overv/openstreetmap-tile-server

docker volume create openstreetmap-data

git clone https://github.com/Overv/openstreetmap-tile-server.git

cd openstreetmap-tile-server/

What i've done :
docker volume create openstreetmap-data
download the appropriate pbf there : http://download.geofabrik.de/

docker run -v /absolute/path/to/luxembourg.osm.pbf:/data.osm.pbf -v openstreetmap-data:/var/lib/postgresql/10/main overv/openstreetmap-tile-server import

If lucky enough then

docker run -p 80:80 -v openstreetmap-data:/var/lib/postgresql/10/main -d overv/openstreetmap-tile-server run

Std output :

root@T450s:/home/ernest# docker run -v /home/ernest/Documents/texas-latest.osm.pbf:/data.osm.pbf -v openstreetmap-data:/var/lib/postgresql/10/main overv/openstreetmap-tile-server import
Unable to find image 'overv/openstreetmap-tile-server:latest' locally
latest: Pulling from overv/openstreetmap-tile-server
898c46f3b1a1: Pull complete 
63366dfa0a50: Pull complete 
041d4cd74a92: Pull complete 
6e1bee0f8701: Pull complete 
b3d49b2dd661: Pull complete 
7f7fd75ed7c3: Pull complete 
ee5c945e49f2: Pull complete 
808e9c0fdf3b: Pull complete 
d780496bb933: Pull complete 
52ddc01564c5: Pull complete 
98df30b28f52: Pull complete 
6806a290c5cc: Pull complete 
fe5da1ed6f5d: Pull complete 
c2b03f1243c3: Pull complete 
892f03c6da75: Pull complete 
60740ad09b89: Pull complete 
510cf260d67d: Pull complete 
e5cf11ef9535: Pull complete 
327759077133: Pull complete 
29fd64d01acc: Pull complete 
6529fd3cf6e4: Pull complete 
7b31de690592: Pull complete 
42ed3f4d774a: Pull complete 
8c1ac07d887f: Pull complete 
9a8a920e2d77: Pull complete 
e8e3c66eb441: Pull complete 
8bcaa423208c: Pull complete 
a64871ac5a50: Pull complete 
Digest: sha256:f8c58ef99819eb73adfaee91401b7f23a878f29122fae285734912657f5082da
Status: Downloaded newer image for overv/openstreetmap-tile-server:latest
+ '[' 1 -ne 1 ']'
+ '[' import = import ']'
+ CreatePostgressqlConfig
+ cp /etc/postgresql/10/main/postgresql.custom.conf.tmpl /etc/postgresql/10/main/postgresql.custom.conf
+ sudo -u postgres echo 'autovacuum = on'
+ cat /etc/postgresql/10/main/postgresql.custom.conf
# Suggested minimal settings from
# https://ircama.github.io/osm-carto-tutorials/tile-server-ubuntu/

shared_buffers = 128MB
min_wal_size = 1GB
max_wal_size = 2GB
maintenance_work_mem = 256MB

# Suggested settings from
# https://github.com/openstreetmap/chef/blob/master/roles/tile.rb#L38-L45

max_connections = 250
temp_buffers = 32MB
work_mem = 128MB
wal_buffers = 1024kB
wal_writer_delay = 500ms
commit_delay = 10000
# checkpoint_segments = 60 # unrecognized in psql 10.7.1
max_wal_size = 2880MB
random_page_cost = 1.1
track_activity_query_size = 16384
autovacuum_vacuum_scale_factor = 0.05
autovacuum_analyze_scale_factor = 0.02
autovacuum = on
+ service postgresql start
 * Starting PostgreSQL 10 database server
   ...done.
+ sudo -u postgres createuser renderer
+ sudo -u postgres createdb -E UTF8 -O renderer gis
+ sudo -u postgres psql -d gis -c 'CREATE EXTENSION postgis;'
CREATE EXTENSION
+ sudo -u postgres psql -d gis -c 'CREATE EXTENSION hstore;'
CREATE EXTENSION
+ sudo -u postgres psql -d gis -c 'ALTER TABLE geometry_columns OWNER TO renderer;'
ALTER TABLE
+ sudo -u postgres psql -d gis -c 'ALTER TABLE spatial_ref_sys OWNER TO renderer;'
ALTER TABLE
+ '[' '!' -f /data.osm.pbf ']'
+ sudo -u renderer osm2pgsql -d gis --create --slim -G --hstore --tag-transform-script /home/renderer/src/openstreetmap-carto/openstreetmap-carto.lua -C 2048 --number-processes 4 -S /home/renderer/src/openstreetmap-carto/openstreetmap-carto.style /data.osm.pbf
osm2pgsql version 0.96.0 (64 bit id space)

Allocating memory for dense node cache
Allocating dense node cache in one big chunk
Allocating memory for sparse node cache
Sharing dense sparse
Node-cache: cache=2048MB, maxblocks=32768*65536, allocation method=11
Mid: pgsql, cache=2048
Setting up table: planet_osm_nodes
Setting up table: planet_osm_ways
Setting up table: planet_osm_rels
Using lua based tag processing pipeline with script /home/renderer/src/openstreetmap-carto/openstreetmap-carto.lua
Using projection SRS 3857 (Spherical Mercator)
Setting up table: planet_osm_point
Setting up table: planet_osm_line
Setting up table: planet_osm_polygon
Setting up table: planet_osm_roads

Reading in file: /data.osm.pbf
Using PBF parser.
Processing: Node(44188k 237.6k/s) Way(4610k 12.36k/s) Relation(26670 952.50/s)  parse time: 587s
Node stats: total(44188377), max(6434488285) in 186s
Way stats: total(4610012), max(686484151) in 373s
Relation stats: total(26922), max(9523915) in 28s
Sorting data and creating indexes for planet_osm_point
Sorting data and creating indexes for planet_osm_line
Sorting data and creating indexes for planet_osm_polygon
Sorting data and creating indexes for planet_osm_roads
Copying planet_osm_roads to cluster by geometry finished
Creating geometry index on planet_osm_roads
Copying planet_osm_point to cluster by geometry finished
Creating geometry index on planet_osm_point
Creating osm_id index on planet_osm_roads
Creating indexes on planet_osm_roads finished
All indexes on planet_osm_roads created in 20s
Completed planet_osm_roads
Stopping table: planet_osm_nodes
Stopped table: planet_osm_nodes in 0s
Stopping table: planet_osm_ways
Building index on table: planet_osm_ways
Creating osm_id index on planet_osm_point
Creating indexes on planet_osm_point finished
All indexes on planet_osm_point created in 75s
Completed planet_osm_point
Stopping table: planet_osm_rels
Building index on table: planet_osm_rels
Stopped table: planet_osm_rels in 4s
Copying planet_osm_line to cluster by geometry finished
Creating geometry index on planet_osm_line
Creating osm_id index on planet_osm_line
Creating indexes on planet_osm_line finished
All indexes on planet_osm_line created in 218s
Completed planet_osm_line
Copying planet_osm_polygon to cluster by geometry finished
Creating geometry index on planet_osm_polygon
Creating osm_id index on planet_osm_polygon
Creating indexes on planet_osm_polygon finished
All indexes on planet_osm_polygon created in 344s
Completed planet_osm_polygon
Stopped table: planet_osm_ways in 385s

Osm2pgsql took 993s overall
node cache: stored: 44188377(100.00%), storage efficiency: 57.43% (dense blocks: 3386, sparse nodes: 24604874), hit rate: 100.00%
+ service postgresql stop
 * Stopping PostgreSQL 10 database server
   ...done.
+ exit 0
root@T450s:/home/ernest# sudo docker run -p 80:80 -v openstreetmap-data:/var/lib/postgresql/10/main -d overv/openstreetmap-tile-server run

and open in your browser : http://localhost/ done you have a tile server running.

I'm not sure how long the docker instance last and may need to be regenerated each time, fine for me I'm using it every 6 month. Please see the github info, if you want to have an docker instance lasting.

Second step : downloading the tile, for that you need Jtiledownloader

See : http://unav.me/offline/ and the snap store


The configuration is pretty simple : as server enter http://localhost:80/tile. then open "slippy map chooser" you should see the map.
Then select the area of interest (defined with left click), set tile zoom level to 10,11,12,13,14,15,16,17 and click download and wait.

Third step :

transfert to the phone... this is up to you, define as the step 6 there : http://unav.me/offline/
I'm suggesting to zip the folder and extract it in the phone.
Personnally, i'm synchronizing my Jtiledownload folder archive to my nextcloud instance and then this instance to my utouch folder, it's longer but "automatic" update.

I hope it will help to reduce your data consumption

Restart from scratch

Following thise link to cleanup docker image, container and volume
https://www.digitalocean.com/community/tutorials/how-to-remove-docker-images-containers-and-volumes

Hello,

As you know to track your activity there is the application Activity Tracker : https://open-store.io/app/activitytracker.cwayne18
Unfortunately due to the Utouch security policy, GPS signal is not accessible when the screen is off or app is in background, that why the original developer force the screen to stay on, reducing significantly the battery life with no benefit.
Issue is tracked there : https://github.com/ubports/ubuntu-touch/issues/1067

Prior using the script please read : https://github.com/ernesst/Utrack/blob/master/README.md

Enjoy.

Marius,

I would see it
Stable devices & software,
Fully integrated with standards like : Mail, Caldav, Webdav, Carddav etc...
Strong base software : Mail, GPS, Communication, Browser,
Overall being secured and hackable.

Then Convergence + Anbox for some proprietary stuff like banking, bus ticket etc..

Hello,
After working on the Halium 7.1 port OP3, i've gave a shot to the Halium 9 thanks to the help of the Halium telegram group especially Erfan.

This use the great work of the Halium developpers and GSI image from Erfan.

This is a proof of concept, only, and not supposed to be run as a daily driver, even if it's possible.
The port is based on

• A trebelized OP3(T) device,
• A modified lineage OS (Trebelized) to acquire the vendors partition
• The Ubports GSI from Erfan (Updated weekly).

Becareful, this is not a standard H7.1 or H9 port but a H9-GSI port, I didn't try to build a device image with H9.

It's running pretty smooth.

To avoid confusion with Halium 7.1 I've created a dedicate repository : https://github.com/OP3-Halium.

Sources:
Kernel: https://github.com/OP3-Halium/android_kernel_oneplus_msm8996
Device (Lineage base): https://github.com/OP3-Halium/android_device_oneplus_oneplus3
Ubports GSI : look into https://t.me/ErfanGSI

Compiles files:
https://drive.google.com/drive/folders/1vnJEKkhO3xqH-fWWG55-yxwx5K1EeKq7?usp=sharing

Status:

• Working:
  Audio
  Calling
  SMS - didn't try
  4G - Yes but no icons - need to activated once after GSI is flashed
  Wifi -Yes I'll apply the same trick than the H7.1
  GPS
  Vibration
  Orientation sensor
  Bluetooth
  camera - zooming is sluggish
  Video recording/decoding
  Fingerprint + home button calling the dash <= Sweet !

• Missing:
  No control of volume during a call
  Flash light - need to make the same trick that 7.1
  ADB/MTP - didn't try yet
  Libertine - didn't try yet
  Anbox - Not tried yet
  others ?

Install:
Everything to install is it there : https://github.com/OP3-Halium/Documentation

Note:

• Once you trebilized your phone, you can still use it as before and install non treble OS.
• I'll migrate the improvment that i've done on the OP3-Ubports to this port.

Anybody willing to help is welcome ^^ even for testing.

Short video : https://gfycat.com/infamousorganicichneumonfly

• PyOtherSide has been integrated to the system since 16.04

• To keep display on : there is an example in Activity Tracker app, not sure if it's the most pretty.
  https://github.com/ernesst/ActivityTracker/blob/master/Main.qml line 45.

Yes from what i've tried.
I'm not a bluetooth user anyway, but i've tried in my car everything works + - good.

I've published the VPN editor app allowing to tune more setting.
this app + pivpn on the otherside works great

https://open-store.io/app/com.ubuntu.developer.pete-woods.vpn-editor

@jujubala1997 said in Help the community:

Where do I start? What are barriers that impede UT from spreading? What should I learn in software to help the community?

Depends your area of interest and confort : community, system, porting, coding, Art etc... and you don't even need to be good or educated in that field, like me just learning by tweaking.

Python wise they are several possibilities :

• full applications : https://github.com/ernesst/ActivityTracker
• Wrapper : https://framagit.org/ernesst/MLS-for-Utouch / https://framagit.org/ernesst/gps-utouch-tracker

Python get integrated into QML via : https://github.com/thp/pyotherside

A very nice python lib would be great to integrate into Utouch : https://github.com/owncloud/pyocclient for Nextcloud/Owncloud.

Welcome in the community.

Most of the guest wifi network request to catch an non https request to bring you to their non secure login page.
So to get the login page try to load a page in http only like http://www.no-ssl.com/ then you should normally get the login page.
Then it's the moment to start your VPN connection.

@manland you can publish. Thanks.

@Stefano

• Bluetooth is rootfs dependent mainly. Cf post of @peat_psuwit.
• Wifi - Not yet, I've found a nicer solution for 7.1 too so I'll update both. But while wait I can tell you we the two files should go. I'll see how it goes on h7.1 but seems way smoother in H9. I hope my update will make smoother H7.1 too.
  As it's still under WIP and GSI is standardize, likely i'll create a patch OP3.
• Flash ligth, i'm using a modified app .. an old indicator, I'll to recompile it for armhf rootfs.

I'm not sure what the firmware change does... I didn't flash specific one for the ubports version and likely they're from latest official Oneplus image. I don't see much problem.
Each time you'ill need to flash halium-boot, lineage modified and ubports GSi.

@Flohack
See my reply there : https://github.com/ubports/ubuntu-touch/issues/1402

Thank you for the tutorial,

However there is still a critical bug flying aroung regarding the password which mostlikely will frustate users

https://github.com/ubports/ubuntu-touch/issues/46

The trick is described at the end of the first post.

Great,

I would add this link on the server side : https://ownyourbits.com/nextcloudpi/

And client side :
The app for bookmark : https://open-store.io/app/umarks.ernesst
and mention that the client mail, video call and music app are working smoothly with the phone.

1. What's the update related to Halium-Utouch ?
2. Do we have a copy of the official ubuntu touch documentation ? Design, develop. etc...
3. Update on the fundation ?
4. What about the latest mir release, what the plan related to it ?
5. What do you think about, allowing blog communication less official like ubuntu planet ? to talk about devel feature landings, tips on using touch etc.. ?

@GizmoChicken said in PinePhone:

However, we need to acknowledge that 16.04 is nearing EOL, and that UBports will, inevitably, need to rebase to something newer, probably Ubuntu 20.04. And, because rebasing to 20.04 necessitates transitioning to systemd, at least some old devices won't support the upgrade, whenever that happens.

All, in order to help, I've create a wrapper in python which scan wifi and gps position.

It's not the most userfriendly, but quite simple to use and can run in background too if the terminal is set for it.

Please test and let me know.
https://framagit.org/ernesst/MLS-for-Utouch/tree/master

Note :

• Upload to MLS is done automatically when the app is closed by a Ctrl+C and phone connected to internet.
• No parallel use with Unav or Activity Tracker test has been properly done yet
• Only tested with Nexus 5, if fail with other device, please create a bug.

If anybody know how to list cells tower around the device, please let me know. So far all the ofono script doesn't allow that

Further implementation : If this script is able to run in background without disturbing user apps, would be interesting to add a on/off button in the GPS menu.

Is there any though to ask Cannonical to send a message to all app publishers in order to inform them about openstore ?

The issue has been solve in the devel and will be released for the OTA3

Your fastboot seems locked,
look here to unlock it : https://forum.xda-developers.com/nexus-4/general/nexus-4-guide-unlock-bootloader-root-t2266654