Topic: OpenBSD & AMD64 (Updated)

We are in contact with a couple of developers from OpenBSD to try and resolve the issues we are experiencing running on the amd64 platform. It was mentioned to us by one of their devs that there is indeed some sort of a amd64 multi-processor bug, however they haven't been able to find it yet.

We are seeing whether we should try to migrate to 4.7-current or downgrade to i386.

Our hardware is in pristine conditions, so this is now purely an OS problem.

Hang in there, we'll get this sorted out.

UPDATE: We are going to be moving to the latest 4.7 amd64 snapshot. If this does not work out, we will probably migrate to i386.

UPDATE #2: Thanks to marco {at} openbsd {dot} org, we were able to find out the cause of the issues we've experienced. The problem is associated with a memory livelock. Judging by other users reports, the bug/problem showed up somewhere after OpenBSD 4.0 and still takes place in 4.6. From what marco let us know, there were multiple livelock fixes in 4.7, so we will be performing an upgrade to move to 4.7-current amd64 today, at 4:00PM EST.

Re: OpenBSD & AMD64 (Updated)

Hi.

I think downgrade to i386 have several limitations, mainly the memory support.
Now, this is part of the growing process of the Operating System, great hardware such DELL server sometimes don't work fine with OpenBSD, I had the same problem running NetBSD a moths ago.

But, I think this is good have bug reports to OpenBSD developers, maybe in the near future have a solid amd64 version on it.  Good luck, I'm logged now.

Re: OpenBSD & AMD64 (Updated)

Yeah, we are in constant talks with a couple of developers.

Their suggestion was to try 4.7-current amd64, and I believe that is what we will be doing. If that doesn't pan out - we will go ahead and just do a final 'give-up' scenario and migrate to i386.

4

Re: OpenBSD & AMD64 (Updated)

I've been running snapshots for a few months now.  Don't know if this will be helpful to you but I've been working on a shell script to help me with upgrades.

I just put the script in my home directory http://devio.us/~barry/snap_upgrade.sh

It works like this:

Download an installxx.iso snapshot from your mirror.
Run the script, the script does this:
  mounts the installxx.iso on /mnt using vnconfig
  removes /x.x if it exists
  copies /mnt/x.x to /x.x
  copies /x.x/{arch}/bsd.rd to /bsd.rd
  cleans up after itself
Reboot and type "boot bsd.rd" at the boot> prompt.
Select the "Upgrade" option.
For "Location of sets?" type "disk"

After the Upgrade remember to use sysmerge(8) and
update packages with: pkg_add -ui -F update -F updatedepends

References:
sysmerge(8)
http://www.openbsd.org/faq/faq14.html#MountImage
http://www.openbsd.org/faq/upgrade47.html
http://www.openbsd.org/faq/current.html
http://www.openbsd.org/faq/faq4.html#Install

Re: OpenBSD & AMD64 (Updated)

ficovh wrote:

I think downgrade to i386 have several limitations, mainly the memory support.

If your comment is about the limit of size of the memory, it isn't a problem in i386 with PAE -at least not with the 4GB that server has now-. Also with i386 the system use less memory without performance degradation smile

I prefer i386 for all servers.

6

Re: OpenBSD & AMD64 (Updated)

Thank you everyone for your comments regarding this. After all, we're in this together. smile

7

Re: OpenBSD & AMD64 (Updated)

I think there's something wrong with the forum timestamps... I am seeing:
First post: Today 2:02 PM
Second post: Today 3:03 PM
3rd: Today 4:04 PM
4th: Today 4:04 PM
5th: Today 4:04 PM
6th: Today 5:05 PM

Re: OpenBSD & AMD64 (Updated)

barry wrote:

I've been running snapshots for a few months now.  Don't know if this will be helpful to you but I've been working on a shell script to help me with upgrades.

I just put the script in my home directory http://devio.us/~barry/snap_upgrade.sh

It works like this:

Download an installxx.iso snapshot from your mirror.
Run the script, the script does this:
  mounts the installxx.iso on /mnt using vnconfig
  removes /x.x if it exists
  copies /mnt/x.x to /x.x
  copies /x.x/{arch}/bsd.rd to /bsd.rd
  cleans up after itself
Reboot and type "boot bsd.rd" at the boot> prompt.
Select the "Upgrade" option.
For "Location of sets?" type "disk"

After the Upgrade remember to use sysmerge(8) and
update packages with: pkg_add -ui -F update -F updatedepends

References:
sysmerge(8)
http://www.openbsd.org/faq/faq14.html#MountImage
http://www.openbsd.org/faq/upgrade47.html
http://www.openbsd.org/faq/current.html
http://www.openbsd.org/faq/faq4.html#Install

I just looked over the script and that would certainly speed the upgrade process up.

We'll announce today when we will be performing the upgrade to 4.7-current.

Upgrading to 4.7-current amd64 takes much less work than downgrading to i386, so we might as well do that first.

9

Re: OpenBSD & AMD64 (Updated)

Great to hear that you're in contact with the OpenBSD devs. I hope that 4.7-current amd64 will just work fine! Guess it was much days/hours of work to narrow down the problem.

Devio.us - user map ~~~ Devio.us @ last.fm ~~~ Devio.us - IRC channel #devious on freenode

You're welcome to join us!

Re: OpenBSD & AMD64 (Updated)

Daniel, could be more specific about the problems with the amd64 platform? and Barry thanks for the script!

11

Re: OpenBSD & AMD64 (Updated)

murilobsd wrote:

Daniel, could be more specific about the problems with the amd64 platform? and Barry thanks for the script!

I've updated the main post with some details.

12

Re: OpenBSD & AMD64 (Updated)

Daniel wrote:

I just looked over the script and that would certainly speed the upgrade process up.

We'll announce today when we will be performing the upgrade to 4.7-current.

Upgrading to 4.7-current amd64 takes much less work than downgrading to i386, so we might as well do that first.

I'm working on the script again today.
Beware, the one I uploaded yesterday had a critical line commented out.
Line 58:    #sudo cp -R /${ISO_REL_R}/${ARCH}/bsd.rd /

That line (obviously) copies the new bsd.rd to /
hmm... that may be why I got all those "bad checksum" errors last night.  I must have been using a bsd.rd from last time I upgraded...

13

Re: OpenBSD & AMD64 (Updated)

barry wrote:

I'm working on the script again today.
Beware, the one I uploaded yesterday had a critical line commented out.
Line 58:    #sudo cp -R /${ISO_REL_R}/${ARCH}/bsd.rd /

That line (obviously) copies the new bsd.rd to /
hmm... that may be why I got all those "bad checksum" errors last night.  I must have been using a bsd.rd from last time I upgraded...

Is there a way for us non-admin users to read your script? It sounds helpful.

14

Re: OpenBSD & AMD64 (Updated)

bmeigs:

Yeah, I just uploaded what I've been working on today, it's in my ~/public_html, get it here:

http://devio.us/~barry/snap_upgrade.sh

Warning: I haven't tested the changes yet, so it's pretty much just for reference at the moment.
I'll probably move it from that location once I get a webpage made to describe it.

Later.

Re: OpenBSD & AMD64 (Updated)

Daniel wrote:
murilobsd wrote:

Daniel, could be more specific about the problems with the amd64 platform? and Barry thanks for the script!

I've updated the main post with some details.

maybe I'm talking nonsense, but it will be possible to have something enabled in the kernel that is causing the livelock?

16

Re: OpenBSD & AMD64 (Updated)

murilobsd wrote:
Daniel wrote:
murilobsd wrote:

Daniel, could be more specific about the problems with the amd64 platform? and Barry thanks for the script!

I've updated the main post with some details.

maybe I'm talking nonsense, but it will be possible to have something enabled in the kernel that is causing the livelock?

From what we understood, this is not due to having any specific feature enabled. It's something related to how memory management is handled on OpenBSD.

17

Re: OpenBSD & AMD64 (Updated)

Figured I'd close the loop here.

My little upgrade script (http://devio.us/~barry/snap_upgrade.sh) has been tested and updated quite a bit this weekend, although still undocumented.

Used it to upgrade two servers at home and four servers at work.  It's still "Use at your own risk." but I'm pretty happy with it.

If anyone wants to use it, I'd suggest reading the script, the references and running it on a test server first.

Re: OpenBSD & AMD64 (Updated)

Barry, good job - the script looks great.

As far as documentation - I think the script is quite self-explanatory and if someone can't follow it, they probably shouldn't be upgrading between releases by themselves.

As far as some suggestions - you could probably expand on how it determines whether it should install the mp or sp kernel; there's some that probably run custom compiled kernels under diff names.  Maybe something that checks how many cpu's the system has? For example:

if [ `sysctl -n hw.ncpu` -gt 1 ];
then
  ...
else
  ... 
fi

In either case, I'd like to move this post to 'sysadmin' section on the forum.

19

Re: OpenBSD & AMD64 (Updated)

barry wrote:

Figured I'd close the loop here.

My little upgrade script (http://devio.us/~barry/snap_upgrade.sh) has been tested and updated quite a bit this weekend, although still undocumented.

Used it to upgrade two servers at home and four servers at work.  It's still "Use at your own risk." but I'm pretty happy with it.

If anyone wants to use it, I'd suggest reading the script, the references and running it on a test server first.

Worked great for me!

Tnx,
Fred