14:06:43 #startmeeting infra weekly 14:06:43 Meeting started Mon May 27 14:06:43 2013 UTC. The chair is ewoud. Information about MeetBot at http://wiki.debian.org/MeetBot. 14:06:43 Useful Commands: #action #agreed #help #info #idea #link #topic. 14:06:52 #chair obasan eedri 14:06:52 Current chairs: eedri ewoud obasan 14:06:53 * obasan here 14:07:05 #chair dcaro 14:07:05 Current chairs: dcaro eedri ewoud obasan 14:07:21 * eedri here, sharing attention with other tasks.. 14:07:35 eedri, you're a natural born multi tasker 14:07:42 * ewoud is also sort of multitasking 14:07:57 and this is the third week in a row I forgot to update the agenda on the wiki 14:08:55 obasan: don't be fooled, he's only a really good context switcher 14:09:08 dcaro, jejejejeje :) 14:09:43 anyways, regarding icinga 14:09:52 I have set up the service and it's working. 14:09:58 #topic icinga 14:10:08 #info obasan set up icinga on monitoring.ovirt.org 14:10:09 in order to connect machines to icinga 14:10:38 I need nrpe installed on all machines that should be monitored 14:10:44 and all the nagios plugins 14:10:49 so I can begin adding services. 14:10:55 does nrpe differ between nagios and icinga? 14:11:03 As far as I understood no 14:11:08 it's 100% compatible 14:11:18 besides icinga and much cooler and has a mobile app and other neat stuff 14:12:07 ok, so we could roll out nrpe clients using puppet? 14:12:30 This is the best solution in my opinion. installing nrpe. installing plugins and keeping the nrpe service alive and running 14:14:14 obasan: in the past I've used nfs to provide the custom nagios plugins, but we can use puppet for that 14:14:21 *too 14:14:42 ok 14:16:02 now we mention puppet, I finally took the time to write a proposal on our repository layout 14:16:22 http://lists.ovirt.org/pipermail/infra/2013-May/003132.html 14:16:28 please have a look and reply 14:16:48 ewoud: I must 14:16:53 and I will 14:16:58 will do 14:17:33 I don't want a definitive layout, just something to get us started which we can improve over time 14:18:01 #info puppet repository proposal was sent 14:18:30 obasan: how much experience do you have with puppet? 14:19:06 ewoud, I am ok with the basics. 14:19:25 obasan: could you have a look at installing nrpe on the clients using puppet? 14:19:36 ewoud, no problem 14:19:39 obasan: cool 14:19:42 ewoud, a class that does it is simple. 14:19:51 ewoud, but we need a puppet master and repo 14:20:02 #action obasan look at installing nrpe using puppet 14:20:11 obasan: we have a master and an empty repo 14:20:20 just one problem: the master is puppet 2.6 14:20:26 and fedora clients have 2.7 14:20:34 ewoud, I suggest updating them both to 3.1 14:20:39 obasan: I agree 14:20:51 ewoud, are there major syntax changes between 2.7 and 3.1? 14:20:52 though puppetlabs already has 3.2, but that should be no problem 14:21:13 ewoud, so 3.2. even better. 14:21:14 obasan: syntax wise not, but the scope has some differences 14:21:24 ewoud, I see. ok 14:21:58 at $employer we've migrated partly to 3.x and I must say I like it better than 2.x 14:22:10 and given we have an empty repo now, upgrading should be easy 14:22:25 I will install the puppetlabs repo and update all clients 14:22:37 #action ewoud update puppet to 3.x using puppetlabs repository 14:23:12 great :) 14:23:27 ewoud, we should take into account we'll have centos/el clients 14:23:39 ewoud, and those won't run puppet 3.x until rhel 7 afaikl 14:23:41 eedri: puppetlabs provides EL6 packages 14:23:51 we do it in production and works well 14:24:00 ewoud, ok 14:24:35 not sure about EL5, but I don't think we have to care about that 14:24:43 also, it's most important that the master is newer than clients 14:25:24 anything else on icinga? 14:25:33 I think that this is it 14:25:33 for now of course 14:25:39 how are we going to manage users there? every ovirt member one account? 14:26:00 ewoud, yes. I think 14:26:05 ewoud, we don't have ldap 14:26:10 ewoud, right? 14:26:11 obasan: how are they managed now? htpaswd? 14:26:12 obasan: no 14:26:37 ewoud, once we have ldap we can use it. until them it's htpasswd 14:26:51 ok 14:27:07 #topic hosting 14:27:16 dcaro: eedri any progress on rackspace hosts? 14:27:35 Hi all 14:27:53 ewoud, dcaro did you try installing with the cdrom? 14:28:27 ewoud, dcaro tried installing it with multiple os, but we keep hitting the DRAC problems no matter what 14:28:30 eedri: I don't have access to the machines 14:28:49 ewoud, sorry, i meant to ping dcaro only :) 14:28:53 eedri: is it a DRAC firmware bug? maybe that needs to be upgraded? 14:29:10 ewoud, quaid suggested we contact rackspace to put a cd in the machine and it might work 14:29:50 ewoud, there is an open bug on it, and a workaround as well, but it also didn't help 14:29:57 eedri: I don't know about the VPN, but can you DHCP + TFTP over it? 14:30:12 ewoud, the vpn issue is resolved 14:31:08 ewoud, i would think that letting them install the os would be optimal, but that's not part of the support 14:31:16 eedri: I'm trying to install using kickstart from foreman, but I don't seem to be lucky, I'll ask them to put in a cd 14:31:50 ewoud: ^ 14:31:50 dcaro, yea.. let's try it simple 14:31:55 * ewoud has to brb 14:34:19 ok, keep us informend 14:34:24 informed* 14:34:27 at least we have now some installation media working on foreman :) 14:35:30 I just did think of something 14:35:38 some RH employee has to request monitoring.ovirt.org 14:35:43 in the DNS 14:35:56 dneary, ^^ ? 14:36:17 ewoud, eedri: Specifically the domain name? 14:36:44 dneary: it should point to 31.15.26.10 14:36:56 ewoud, eedri: Can one of you open a ticket in Trac, and I will ensure it is looked at? We should initially assign it to Theron 14:37:07 can we do that any subdomain will point there also? it comes very handy when doing tests and similar things 14:37:15 ewoud, That's a piwik install? 14:37:40 dneary: no, icinga and I hope to add something like munin for trending as well 14:37:49 ewoud, Or onitoring in the nagios sense? 14:38:30 dneary: so in the nagios sense 14:38:38 ok 14:38:43 We definitely need that 14:39:27 we shouldn't have issues with full disks etc, rather sad we had downtime in this time 14:40:07 ewoud, i understood that the ovirt-instance on alterway2 is lacking of space? 14:40:26 ewoud, can't we add another lvm to it ? 14:40:30 eedri: the LV was rather small I think 14:41:29 ewoud, i understood that it might be a problem to extend it on a running system? 14:41:49 eedri: I think Kiril was looking into it 14:42:18 ewoud, natually i would think that we can just extend it 14:42:32 eedri: do you know where Kiril is? 14:43:02 ewoud, he's ooo 14:43:13 ewoud, i think there shouldn't be a problem with extending the vg/lv 14:43:24 ewoud, we might want to check that on a test vm with ovirt-engien 14:43:35 ewoud, before doing it on alterway2 14:43:43 eedri: I don't know if you can expand a storage volume in ovirt 14:44:33 ewoud, maybe asking on users/devel list? 14:44:59 eedri: Kiril was checking with someone from storage I think, but couldn't hurt to ask on users/devel 14:46:05 dneary: can we ask for globbed subdomains? *.monitoring.redhat.com for example? 14:46:23 dcaro: what do you want that for? 14:46:49 or did you mean *.monitoring.ovirt.org? 14:46:56 dcaro, I don't know - we can try. 14:47:02 dcaro, What is the use-case? 14:47:04 ewoud: yep, it comes very handy when doing upgrades, installing new services... 14:47:33 f.e. munin.monitoring.ovirt.org will point to that, we can have a vhost for munin 14:47:57 or if we want to try other services/version we can have them in parallel without having to ask for new domain entries 14:48:25 dcaro, I'm no DNS expert - how easy is something like that in BIND? 14:48:29 dcaro: I'd like to just have control over the domain so maybe we should look into something 14:48:33 it's just one entry 14:49:54 ewoud: that'd be the best option, sure 14:50:49 I have no experience with domain providers other than some two Dutch providers 14:51:02 one of which being my employer 14:51:55 dcaro: I usually just install bind on my own and manage it from there :S (always had redundant machines for that) 14:52:11 but I've used also a couple of spanish and french providers 14:52:49 maybe we should just ignore it for now, plenty of other tasks 14:53:13 #topic jenkins 14:53:15 anything new? 14:54:26 eedri: dcaro ? 14:54:54 ewoud: not afaik 14:54:57 ok 14:55:06 #topic other business 14:55:22 I think we should move the meeting to another time, so I'll propose something on the ML 14:57:22 ewoud, yes 14:57:27 ewoud, there is one issue on #jenkins 14:57:44 eedri: backups? 14:57:46 ewoud, kiril sent an email on backing up jenkins 14:57:48 ewoud, yes 14:57:53 ewoud, no one replied 14:58:07 ewoud, this is very important issue, since we currently don't have backups 14:59:06 I have one other piece of business 14:59:21 eedri: I'll have a look 14:59:31 We have some updates that need to be applied to the theme to defend against potential XSS 14:59:55 dneary, which theme? 15:00:06 speaking of updates, we should also update the machines at alterway with the latest yum updates 15:00:09 The website themeI need a volunteer with time to apply the fix and check - and we should review the theme to ensure that 15:00:33 ... to ensure that the same problem isn't affecting the site elsewhere 15:00:33 dneary: Error: ".." is not a valid command. 15:00:51 ovirtbot, I didn't kniw . did anything special 15:00:51 dneary: Error: "I" is not a valid command. 15:01:04 ovirtbot, thanks 15:01:04 dneary: Error: "thanks" is not a valid command. 15:01:21 * dneary stops messing and gets serious again 15:01:42 dneary: I'd help, but not sure I have the time 15:05:47 eedri: can you update jenkins.ovirt.org? 15:06:16 ewoud, yum update? 15:06:20 eedri: yes 15:06:26 ewoud, yes 15:06:28 ewoud, but 15:06:33 ewoud, wouldn't we want to run backup 1st? 15:06:44 eedri: true 15:07:07 yep! 15:07:17 same could be said for alterway02 btw 15:07:35 dneary: maybe you can mail the ML for help? 15:10:22 anyway, I think we should close the meeting 15:10:48 #action eedri update jenkins.ovirt.org after a backup was made 15:10:51 going once 15:12:01 #endmeeting