View Full Version : HS Package Updater problems using local psoft mirror
stevewest15
03-15-07, 14:35
Hi,
Has anyone been able to run an HS update using a psoft local mirror? I setup the local mirror using psoft doc (http://www.psoft.net/HSdocumentation/sysadmin/mirroring.html) but when I run the HS update script, it seems it can't download anything:| |-- Check/install hsphere update package.
| | |-- *** Problem to download hsphere-update-1.1-6.rpm package. (hsupdate skipped) ***.
| | |-- *** Problem to download hsphere-update-1.1-6.rpm package. (hsupdate skipped) ***.
| | |-- *** Problem to download hsphere-update-1.1-6.rpm package. (hsupdate skipped) ***.
| | `-- Check/install hsphere update package.
| `-- Hsphere box update preparations.
|
|-- All required preparations are done.
|
|-- Upgrade started.
| |
| | |-- Downloading pkglist.
| | |-- Downloading error!
| | `-- For more details see /hsphere/pkg/updates/U25.0/U25.0P9/update_15.03.07_03_51.log file
| | |-- Downloading pkglist.
| | |-- Downloading error!
| | `-- For more details see /hsphere/pkg/updates/U25.0/U25.0P9/update_15.03.07_03_51.log file
| | |
| | `-- Finished update
| |
| `-- Upgrade finished.When I try to go and see what the update log it references above (/hsphere/pkg/updates/U25.0/U25.0P9/update_15.03.07_03_51.log), there is no such file. :(
Anyone out there been able to get HS package updater to use a local psoft mirror? Please let me know how u did it...
thx,
SW
If you check your mirror, if I am not mistaken you dont have hsphere-update-1.1-6.rpm :) maybe that might be the problem?
Hello,
If you check your mirror, if I am not mistaken you dont have hsphere-update-1.1-6.rpm maybe that might be the problem?
This was the exact error I got the other night. The package did exist and was valid on all servers. So I passed a option to hspackages "skip=check" and it got past this error.
Now where this gets you next Steve I am very interested in knowing.
Francesca
stevewest15
03-15-07, 15:15
Hi Evren & Francesca,
That package should NOT be present in the mirror but instead, psoft update script should download it directly from psoft site at the following URL:
http://www.psoft.net/shiv/HS/releases/U25.0/pkgs/OSD/
So, if you go to http://www.psoft.net/shiv/HS/releases/U25.0/pkgs/RHES4/ you will see the hsphere-update package...but the mirror pulls the files from the following path which doesn't contain the hsphere-update: http://www.psoft.net/shiv/HS/RHES4/
To me this is a big mess which doesn't make sense as to why having two different locations w/ 2 different set of packages.
I'll try Francesca's suggestion and see if the update will work.
SW
EDIT: The Psoft doc says the following which is why I'm saying what I said above:Package lists (pkglist, sspkglist, subpkglist, pkglist.priv) are downloadable mainly from psoft.net.So I took this to assume hsphere-update* and a few other psoft packages will need to come from psoft site directly rather than the local mirror.
This was the exact error I got the other night. The package did exist and was valid on all servers. So I passed a option to hspackages "skip=check" and it got past this error.
Well Steve doesnt have this package in his mirror. I checked the psoft scripts and from what I can see, you shouldnt receive this error if you have the file in the right place.
As a matter of fact if you followed the manual, you wouldnt have this package. Please check:
http://www.psoft.net/HSdocumentation/sysadmin/mirroring.html
the download location from manual:
http://www.psoft.net/shiv/HS/releases/U25.0/pkgs/RHES4/
original place:
http://www.psoft.net/shiv/HS/RHES4/
As a matter of fact, the default mirror location the h-sphere script uses is:
http://www.psoft.net/shiv/HS
As you can see this package is missing from the location the manual is talking about.
Thanks,
Evren
That package should NOT be present in the mirror but instead, psoft update script should download it directly from psoft site at the following URL:
http://www.psoft.net/shiv/HS/releases/U25.0/pkgs/OSD/
Steve this is a mistake in psoft's mirror. They forgot to include this file in the mirror. Just download it and put to your version.
The install script fetches all packages from the same location. As a matter of fact, you could mirror the default locations instead, for example
http://www.psoft.net/shiv/HS/RHES4/
Then your mirror can be used to upgrade any version of h-sphere supporting the OS you mirrored, I guess psoft wanted to save some bandwidth here :p
Thanks,
Evren
I made a bug report about this to psoft. They probably would fix it sometime.
https://bugs.trustix.org/show_bug.cgi?id=2155
Evren,
I got that error because at the time the file did NOT exist anywhere. It occurred during the great server meltdown over the weekend.
What and how things are now I am not sure. I am just relating that I saw this same error the other night and how to skip that check if the packages exist on the server. Since if that is the case. Its not the reason the rest of the mirror setup is not working.
Francesca
stevewest15
03-18-07, 00:41
Hi folks,
Just thought to update everyone who is thinking about running a local mirror.
I was finally able to get the local mirror working. It appears Psoft mirror doc (http://www.psoft.net/HSdocumentation/sysadmin/mirroring.html) is incorrect or they failed to sync the necessary files for the HS Updater script to run properly.
So here is what I did:
1. I mirrored Psoft main package site (ie http://www.psoft.net/shiv/HS/) instead of the one their mirror doc points too.
2. Changed the cron jobs to the following to work w/ directories in the main package mirror:0 1 * * * (cd /path_to_mirror/shiv/HS/RHES3/; wget --mirror --limit-rate=85k -np -nH --cut-dirs=3 -erobots=off http://www.psoft.net/shiv/HS/RHES3/)
0 1 * * * (cd /path_to_mirror/shiv/HS/RHES4/; wget --mirror --limit-rate=85k -np -nH --cut-dirs=3 -erobots=off http://www.psoft.net/shiv/HS/RHES4/)
0 1 * * * (cd /path_to_mirror/shiv/HS/FBSD55/; wget --mirror --limit-rate=85k -np -nH --cut-dirs=3 -erobots=off http://www.psoft.net/shiv/HS/FBSD55)
0 1 * * * (cd /Backups/HS_Mirror/shiv/HS/FBSD62/; wget --mirror --limit-rate=85k -np -nH --cut-dirs=3 -erobots=off http://www.psoft.net/shiv/HS/FBSD62/)Add/Change thel OS flavors above to match your HS cluster.
3. So now your local mirror should be accessed via a URL that looks like this: http://yourdomain.com/shiv/HS/
4. Run the following command on all HS servers (make sure to change the domain name below to match yours):# echo 'http://yourdomain.com/shiv/HS/' > /hsphere/shared/etc/mirror
Unfortunately, if Psoft site is down, you won't be able to run hspackages because it still requires to download some components from Psoft site. :( This is something I think Psoft should not require but instead should be downloaded to the local mirror.
Other than this, the local mirror really does speed up the update process. The above 4 OS mirrors takes about ~20GB of disk space.
Hope this helps someone...
SW
Steve,
Unfortunately, if Psoft site is down, you won't be able to run hspackages because it still requires to download some components from Psoft site. This is something I think Psoft should not require but instead should be downloaded to the local mirror.
Well this is nice. So mirrors are only useful to cache most of the packages locally. Then its useless in the case we had last weekend where psoft.net was down.
Maybe what needs to happen is that PSOFT needs more mirrors. Judging by last weekends outage it appears that they are only using one server. They make millions of dollars a year and can only afford one freaking server. And instead of upgrading and expanding there own mirrors leave it up to us to foot the bill so to speak for their cheapness.:mad:
Francesca
vBulletin® v3.7.2, Copyright ©2000-2010, Jelsoft Enterprises Ltd.