Bug 17279 - OwnCloud server upgrade path Mageia 5 to Mageia 6
Summary: OwnCloud server upgrade path Mageia 5 to Mageia 6
Status: RESOLVED FIXED
Alias: None
Product: Mageia
Classification: Unclassified
Component: Backports (show other bugs)
Version: 5
Hardware: All Linux
Priority: Normal normal
Target Milestone: ---
Assignee: QA Team
QA Contact:
URL:
Whiteboard: MGA5-64-OK MGA5-32-OK
Keywords: Backport, IN_ERRATA6, validated_backport
Depends on:
Blocks:
 
Reported: 2015-12-02 23:19 CET by Morgan Leijström
Modified: 2017-05-28 10:31 CEST (History)
5 users (show)

See Also:
Source RPM:
CVE:
Status comment:


Attachments

Description Morgan Leijström 2015-12-02 23:19:46 CET
Description of problem: Current 8.0.9 is old but should be updated regularly.

I learned from https://bugs.mageia.org/show_bug.cgi?id=16658#c14 that 8.2.1 is already in mga5 updates testing.

So now tried update 8.0.9 -> 8.2.1 by simply using MCC with updates testing enabled.

( Strange: For some reason it did automatically deselect 8.0.9 when i chosed 8.2.1   -- I am too tired to think about that right now. )

I restarted apache (forgot to check if it was needed)

Then i used Firefox to browse to it and it greeted me with the useful question about starting the updating procedure.

It immediately stopped with the message:

         Exception: Updates between multiple major 
         versions and downgrades are unsupported.

And that is intended, see:
https://doc.owncloud.org/server/8.1/admin_manual/maintenance/upgrade.html :
It is best to keep your ownCloud server upgraded regularly, and to install all point releases and major releases without skipping any of them, as skipping releases increases the risk of errors. Major releases are 8.0, 8.1, 8.2, and 9.0. Point releases are intermediate releases for each major release. For example, 8.0.9 and 8.1.3 are point releases. Skipping major releases is not supported.

Note that last sentence "Skipping major releases is not supported."
And good it does not even try.

So we need to ship update to 8.1.x first.

Then the delay between releasing that and next should be long enough that "everybody" get the 8.1.x update AND perform the web initiated upgrade before we push 8.2.x  Is two weeks enough?  (think busy one man company (or student ;) that is happy if he have time in a weekend...?)

PS  i uninstalled 8.2.1 and installed 8.0.9 again, rebooted, OK  DS

Reproducible: 

Steps to Reproduce:
Comment 1 Morgan Leijström 2015-12-02 23:28:10 CET
OOPS yes i am tired, forgot the important "not":

I wrote   "did automatically deselect"

should be "did NOT automatically deselect"
Comment 2 José Jorge 2015-12-02 23:36:58 CET
I think that we should push this to backports : the version 8.0.x is still supported, and release notes for 8.1 and 8.2 explain that there are regressions like "Using ownCloud without a trusted_domain configuration will not work anymore." It also explains that migration is to be finished manually!

I would expect Mageia owncloud package to not break itself simply updating the system, so again please push as BACKPORT.

CC: (none) => lists.jjorge

Comment 3 Morgan Leijström 2015-12-02 23:51:02 CET
Good catch.  There are also other issues that may emerge.   Backports then.

https://doc.owncloud.org/server/8.2/admin_manual/release_notes.html
Comment 4 Morgan Leijström 2016-01-12 13:35:17 CET
Ping...
8.1x is needed as intermediate upgrade
8.2.2 was released december 22
I can back up my system and test built packages, upgrading to 8.1x first.

CC: (none) => luigiwalser, mageia

Comment 5 José Jorge 2016-01-29 08:21:52 CET
So I think we should push 8.1.x for now to backports, allowing voluntary upgrade for users. And add it to release notes of MGA6, that it is suggested to switch to backport version before upgrading to 8.2.x version.

If this is agreed, I can do this backport. WDYT Nicolas?

Status: NEW => ASSIGNED

Comment 6 David Walser 2016-01-29 12:08:27 CET
I think we pretty much need to do this, since those upgrading to Mageia 6 will need to update to 8.1.x before upgrading to Mageia 6's 8.2.x.
Comment 7 Morgan Leijström 2016-01-29 13:20:56 CET
Good point David.  8.1.x in mga5 is essential then.

And mga6 will have owncloud 8.3.x in release
then we absolutely also need 8.2.x too in mga5 backports.
Comment 8 Morgan Leijström 2016-01-29 13:21:55 CET
As 8.2 is released it is of course good to have it too in mga5 backports...
(Coffe started working now)
Comment 9 Morgan Leijström 2016-02-25 11:29:27 CET
Thank you for the 8.0.10 update david.
If anyone attempt 81 and 8.2 backports i can try them.
Comment 10 José Jorge 2016-02-25 12:23:15 CET
(In reply to Morgan Leijström from comment #9)
> Thank you for the 8.0.10 update david.
> If anyone attempt 81 and 8.2 backports i can try them.

I think we will only provide 8.1 backports when either :
- 8.0 is not provided anymore
- MGA6 will be out and then the upgrade path will be install MGA5 8.1 as update then upgrade to MGA6.
Comment 11 Morgan Leijström 2016-02-25 15:56:29 CET
I am afraid many users then will upgrade mga5 to mga6 and not until after that realise they should have waited for owncloud 8.1 on mga5 first.
I added Upgrade chapter https://wiki.mageia.org/en/OwnCloud#Upgrading
Comment 12 David Walser 2016-02-25 15:59:57 CET
Yes, we will need to add a note about this to the Mageia 6 Release Notes.
Comment 13 Morgan Leijström 2016-04-29 14:07:18 CEST
Now 9 and 9.0.1 have been released, with some issues.

There is interesting reading 
https://forum.owncloud.org/viewtopic.php?f=38&t=33274

So i suggest to have upcoming 9.0.2 or later in mga6 at release.

Maybe we should discuss if we should just simply skip making 8.1 and 8.2 ?
And in errata tell about the problem.
There are much possible troble for the user either way, three incremental updates, or one big, or reinstall and get new data synced/restored....

I think i will myself make a fresh install of mga6 including fresh install of owncloud 9.x...
Comment 14 Morgan Leijström 2016-04-29 14:38:23 CEST
Will mga6 release with PHP7.0.6? or update to it soon?

OwnCloud 9.0.3 (not 9.0.2 or earlier) will work with PHP7.0.6
https://github.com/owncloud/core/pull/24326
https://github.com/owncloud/core/pull/24343
(BTW, possibly there will be fix backported to owncloud 8.x and 9.0.0 )

9.0.2 is due may3
https://github.com/owncloud/core/milestones

When someone packages 9.0.2 for cauldron 64 bit, and we have PHP7 < 7.0.6 i will consider reinstalling my in-house production fileserver to mga6 and that owncloud - if i see no other problem.  Else maybe wait for 9.0.3.
Comment 15 Morgan Leijström 2016-04-29 14:41:24 CEST
For visibility i changed issue to concern Cauldron and MGA5TOO, as solving owncloud server upgrading concerns both.

Version: 5 => Cauldron
Whiteboard: (none) => MGA5TOO

Comment 16 José Jorge 2016-10-14 17:45:36 CEST
As talked in MGA DEV ML, I have pushed version 8.1.10 to backports testing.
I will also push 8.2.8 version and 9.0.5 when this 8.1.10 version will be tested and validated.

The only rpm is a noarch owncloud-8.1.10-1.mga5

Keywords: (none) => Backport
Version: Cauldron => 5
Assignee: mageia => qa-bugs
Summary: Update owncloud server to 8.2.1 need first 8.1.x ! => Backport Candidate: Upgrade owncloud to 8.1.10
Whiteboard: MGA5TOO => (none)

José Jorge 2016-10-14 17:46:41 CEST

Component: RPM Packages => Backports

Comment 17 Morgan Leijström 2016-10-14 22:28:19 CEST
Thank you for your work :)

First I updated to owncloud-8.0.15-1.mga5.noarch.rpm from /core/updates_testing
Test OK, see Bug 19574 - Owncloud 8.0.15 fixes bugs in upgrade to 8.1.x

Then using MCC I installed owncloud-8.1.10-1, rebooted.
Logged into owncloud web interface and initiated the update
Error popped upp immediately in that dialog:

  Exception: Please upload the ca-bundle.crt file into the 'config' directory.

which ca-bundle.crt ?


Question:
Are we going to skip and withdraw the 8.2.1 now in updates testing?
I *think* so, but am too lazy/busy read up on owncloud recommendations atm...
Comment 18 Morgan Leijström 2016-10-14 22:43:01 CEST
This is probably a manual solution: (i have not tested yet)
https://forum.owncloud.org/viewtopic.php?t=30540

-but best if package can be made to work without it.

This is a known bug which was targeted 8.0.15 (?)
https://github.com/owncloud/updater/issues/164
still "to review?!"
https://github.com/owncloud/updater/pull/367

Possibly i have long ago fiddeld with configuration files to make it work better then, so maybe i have done something then that borked the update now.
Comment 19 José Jorge 2016-10-14 22:46:56 CEST
(In reply to Morgan Leijström from comment #17)
> Error popped upp immediately in that dialog:
> 
>   Exception: Please upload the ca-bundle.crt file into the 'config'
> directory.
> 
> which ca-bundle.crt ?

This was a bug in my packaging. Please try with owncloud-8.1.10-2.mga5 when it will it the mirrors. Which both fixes this and recommends php-opcache to give better default performance.

> Question:
> Are we going to skip and withdraw the 8.2.1 now in updates testing?
> I *think* so, but am too lazy/busy read up on owncloud recommendations atm...

Yes, the plan is to push 8.2.8 in backports when 8.1.10 will be validated and pushed to core/backports.
Comment 20 Morgan Leijström 2016-10-15 13:57:12 CEST
Test OK:
I did nothing more since comment 17, just urpmi owncloud-8.1.10-2.mga5,
and then into web interface (no need to reboot),
and initiated the upgrade which went quick, and it works.

Setting FOR ERRATA as per discussion in dev ML we need to write notes there,  https://wiki.mageia.org/en/Mageia_6_Errata

directing Owncloud Users to read https://wiki.mageia.org/en/OwnCloud#Upgrading


Waiting for your 8.2.latest and then 9.0.latest  :)

Summary: Backport Candidate: Upgrade owncloud to 8.1.10 => OwnCloud server upgrade path Mageia 5 to Mageia 6
Whiteboard: (none) => FOR ERRATA

Comment 21 Samuel Verschelde 2016-10-15 15:48:29 CEST
(In reply to Morgan Leijström from comment #20)
> Setting FOR ERRATA as per discussion in dev ML we need to write notes there,
> https://wiki.mageia.org/en/Mageia_6_Errata

Changing to FOR_ERRATA6 which is what will be used for Mageia 6 Errata along with IN_ERRATA6 once written.

Whiteboard: FOR ERRATA => FOR_ERRATA6

Comment 22 Morgan Leijström 2016-10-15 15:51:22 CEST
Thanks Samuel.
Do we have a list of code words like this, where?
Comment 23 Samuel Verschelde 2016-10-15 16:32:28 CEST
(In reply to Morgan Leijström from comment #22)
> Thanks Samuel.
> Do we have a list of code words like this, where?

Most are written in the wiki, but this one it probably not defined anywhere. I'm probably the first one to state it outside of IRC. We need to update the appropriate wiki page somewhere. We probably also need to make that a keyword rather than a whiteboard entry. Feel free to start the discussion on the dev ML, I'll follow-up.

Samuel
Comment 24 David Walser 2016-10-16 20:20:45 CEST
This commit is incorrect:
http://svnweb.mageia.org/packages/backports/5/owncloud/current/SPECS/owncloud.spec?r1=1060819&r2=1060818&pathrev=1060819

You should *not* bundle a ca-bundle.crt file, the package should install a symlink to the system one in /etc/pki/tls/certs.

Whiteboard: FOR_ERRATA6 => FOR_ERRATA6 feedback

Comment 25 José Jorge 2016-10-16 21:11:54 CEST
(In reply to David Walser from comment #24)
> You should *not* bundle a ca-bundle.crt file, the package should install a
> symlink to the system one in /etc/pki/tls/certs.

Thanks for the hint. Fixed in 

owncloud-8.0.15-3.mga5.noarch.rpm
Comment 26 Morgan Leijström 2016-10-17 09:58:13 CEST
Me who installed 8.0.15-2, and then 8.1.10-1, what should i do to be on track?
(so i test next step from correct state)
Comment 27 José Jorge 2016-10-17 18:33:18 CEST
(In reply to Morgan Leijström from comment #26)
> Me who installed 8.0.15-2, and then 8.1.10-1, what should i do to be on
> track?
> (so i test next step from correct state)

I said something silly. It is version 8.1.10-3 that fixes the problem. So you can just install it. I think we should validate this 8.1.10 and push it to backports before pushing 8.2.x to testing.

So please indicate if you tested on 32 or 64 bits.

Whiteboard: FOR_ERRATA6 feedback => FOR_ERRATA6 MGA5-64-OK

Comment 28 Morgan Leijström 2016-10-17 19:40:07 CEST
OK.  I urpmi 8.1.10-3, and also rebooted, this time no question of updating database (And i did not expect it)  It just continue to work.
mga5 64bit

IMO, fix that cert problem in 8.0.15 before pusing to updates
Comment 29 José Jorge 2016-10-17 21:18:16 CEST
(In reply to Morgan Leijström from comment #28)
> IMO, fix that cert problem in 8.0.15 before pusing to updates

No, Owncloud started with this certificate only in 8.1.x versions...

I could test another system I have, which is 32 bit. All is Ok.

Whiteboard: FOR_ERRATA6 MGA5-64-OK => FOR_ERRATA6 MGA5-64-OK MGA5-32-OK

Samuel Verschelde 2016-10-18 13:15:46 CEST

Keywords: (none) => FOR_ERRATA6
Whiteboard: FOR_ERRATA6 MGA5-64-OK MGA5-32-OK => MGA5-64-OK MGA5-32-OK

Comment 30 Lewis Smith 2016-10-19 20:46:20 CEST
Many thanks to José & Morgan for your work on this difficult backport.
Validated.
Can sysadmins please push it.

Keywords: (none) => validated_backport
CC: (none) => lewyssmith

Comment 31 Nicolas Lécureuil 2016-10-19 22:12:53 CEST
done.

Status: ASSIGNED => RESOLVED
CC: (none) => mageia
Resolution: (none) => FIXED

Comment 32 José Jorge 2016-10-21 16:14:17 CEST
Upgrade to 8.2.8 in the #19634 bug.
Comment 33 Morgan Leijström 2016-10-24 04:29:23 CEST
@José

I wonder if you saw some problem with php-opcache?

I do not currently, but i have seen problems before:
https://wiki.mageia.org/en/OwnCloud#To_do_in_this_document
https://wiki.mageia.org/en/OwnCloud#PHP_caching

Of this problem is obsolete, we can strip the text about the problem from the wiki.

BTW I also split the wiki article "Introduction" so there now is a news section
https://wiki.mageia.org/en/OwnCloud#News
Comment 34 José Jorge 2016-10-24 09:15:25 CEST
(In reply to Morgan Leijström from comment #33)
> @José
> 
> I wonder if you saw some problem with php-opcache?
> 

I've never had problems with php-opcache, which is Recommended by owncloud package. So if you have no reproductible bug, I think we can remove this warning.
Comment 35 Morgan Leijström 2016-10-24 11:13:00 CEST
OK, I removed the warning, and also added instruction on adding a line in config for enabling APCu, quick test OK here.

I have for long time not made a fresh install of owncloud.
Do you know if bug 16179 is resolved? - If so please close it.
Comment 36 Morgan Leijström 2016-10-24 16:30:33 CEST
Maybe also the Mageia 6 owncloud package should recommend php-opcache?
Lewis Smith 2016-10-24 17:16:26 CEST

CC: lewyssmith => (none)

Comment 37 Morgan Leijström 2016-10-25 10:13:34 CEST
(In reply to Morgan Leijström from comment #36)
> Maybe also the Mageia 6 owncloud package should recommend php-opcache?

Or, let it be. I better re-add it to instructions instead?
Comment 38 José Jorge 2016-10-26 11:29:39 CEST
(In reply to Morgan Leijström from comment #37)
> (In reply to Morgan Leijström from comment #36)
> > Maybe also the Mageia 6 owncloud package should recommend php-opcache?
> 
> Or, let it be. I better re-add it to instructions instead?

No need. owncloud requires php-opcache in Mageia 6.
Comment 39 Morgan Leijström 2016-10-26 12:30:32 CEST
Uhm.. i was going to check, but can not find any owncloud server in cauldron anywhere?? - Strange, i know i saw it before...?!

And if i on my cauldron try
 urpmi owncloud
it wants to install * Nextcloud 10 * ( and much more, including php-opcache )
Comment 40 David Walser 2016-10-26 12:42:48 CEST
In Cauldron, Nextcloud replaces ownCloud.
Comment 41 Morgan Leijström 2016-10-26 14:22:15 CEST
Ah, so no ownClud server at all in mga6?

OK clean and nice.


*  But, then we need also ownCloud 9.0.5 in mga5 backport, now !  *


BTW, What is the plan for nextcloud client ?
Comment 42 David Walser 2016-10-26 14:25:15 CEST
(In reply to Morgan Leijström from comment #41)
> Ah, so no ownClud server at all in mga6?

Nextcloud is a drop-in replacement, so it is the ownCloud server for mga6.

> OK clean and nice.
> 
> 
> *  But, then we need also ownCloud 9.0.5 in mga5 backport, now !  *

IIRC, Nextcloud can upgrade from oC 9, so yeah I guess so.

> BTW, What is the plan for nextcloud client ?

I have no idea.
Comment 43 Morgan Leijström 2016-10-26 14:55:17 CEST
Yes, upgrades from both OC 9.0 and 9.1 to Nextcloud 10 should officially work.

From 8.2 people have both failed and succeeded upgrading to Nextcloud after manual work... so we need (at least) 9.0.latest in mga5.


For Nextcloud clients it looks like it is still same as owncloud client, same last version numbers.

So i suggest we keep the owncloud client we have in cauldron, which is the latest, and when there is a newer Nextcloud client we switch brand.


BTW, someone still have to verify the newest client on mga5, Bug 19583 - Backport Candidate: Update owncloud-client to 2.2.4   Possibly i can try next week on a colleagues mga5-64

For mga5 the later clients are to come in backport because update 1.x to 2.x needed manual (re)configuration.

Unless they screw up compatibility again, client updates in cauldron can be in normal updates repo.


I guess Nextcloud server updates are disruptive like on mga5 (?), so server updates shall probably be in backports, analogous to what we now do on mga5
Comment 44 David Walser 2016-10-26 14:58:42 CEST
(In reply to Morgan Leijström from comment #43)
> I guess Nextcloud server updates are disruptive like on mga5 (?), so server
> updates shall probably be in backports, analogous to what we now do on mga5

My understanding is that Nextcloud plans to handle upgrades better and more responsibly than ownCloud has.
Comment 45 Nicolas Lécureuil 2016-10-26 15:20:30 CEST
(In reply to Morgan Leijström from comment #41)
> Ah, so no ownClud server at all in mga6?
> 
> OK clean and nice.
> 
> 
> *  But, then we need also ownCloud 9.0.5 in mga5 backport, now !  *
> 
> 
> BTW, What is the plan for nextcloud client ?

it will be packaged
Comment 46 Morgan Leijström 2016-10-26 15:33:26 CEST
(In reply to David Walser from comment #44)
> My understanding is that Nextcloud plans to handle upgrades better and more
> responsibly than ownCloud has.

That is a good direction.
We need to test that practically in whatever_testing when it is due.
Comment 47 José Jorge 2016-10-26 22:52:04 CEST
(In reply to David Walser from comment #40)
> In Cauldron, Nextcloud replaces ownCloud.

The owncloud package seems to have been dropped from mirrors, but the package was not moved to obsoletes?

Anyway, I will push Oc9.0 to MGA5 backports as this is now needed : #19662.
Comment 48 Morgan Leijström 2016-10-26 22:59:13 CEST
Great, i will test mga5 Oc9.0 when it lands

@José: if you in a comment write "bug " before the bug number it will automatically be a helpful link: bug 19662
Comment 49 Marja Van Waes 2017-03-06 17:40:59 CET
Thx to whoever added this to the Mga6 errata

Keywords: FOR_ERRATA6 => IN_ERRATA6
CC: (none) => marja11

Comment 50 Morgan Leijström 2017-03-10 16:35:19 CET
Thanks Marja, it was me :)
Now i also added a hint at https://wiki.mageia.org/en/Mageia_6_Release_Notes#Upgrading_from_Mageia_5 because this is a rather unusual procedure.
Comment 51 Morgan Leijström 2017-05-28 10:31:12 CEST
Time have passed and we now need more versions to bridge the gap mga5 to 6, i issued a fresh Bug 20953 for continued work.

Note You need to log in before you can comment on or make changes to this bug.