14:01:03 #startmeeting 14:01:03 Meeting started Tue Jul 31 14:01:03 2012 UTC. The chair is Guest1332. Information about MeetBot at http://wiki.debian.org/MeetBot. 14:01:03 Useful Commands: #action #agreed #help #info #idea #link #topic. 14:01:17 eedri: cool 14:01:21 * RobertM Here 14:01:22 btw, anyone is welcome to start the meeting, then hand out chair :) 14:01:24 * eedri here 14:01:30 * Guest1332 looks at nickserv 14:01:33 <= quaid 14:01:45 I was wonder who that was :) 14:01:46 #meetingname oVirt Infra weekly 14:01:46 The meeting name has been set to 'ovirt_infra_weekly' 14:01:58 quaid is using an anonymous irc :) 14:02:34 * mburns here 14:02:44 though distracted... 14:02:49 same here 14:03:26 #topic Agenda 14:03:29 http://wiki.ovirt.org/wiki/Infrastructure_team_meetings#2012-07-31 14:03:39 We never sent out an agenda so I created one about 10 Min ago. I suggest we hold off on Jenkins until everything else is covered then we can spend the rest of the meeting on Jenkins 14:03:41 we have enough leftover from last week ... :) 14:03:49 RobertM: +1 14:04:08 well, let's see 14:04:18 is ewoud here to talk about Puppet? 14:04:19 * ewoud is sort of distracted 14:04:23 heh 14:04:33 deadlines and all 14:04:41 ewoud: do you want to hold that topic for next week or mailing list? 14:04:58 quaid: please 14:05:48 #topic Hosting needs 14:06:06 ah, no chanops for ovirtbot 14:06:12 * eedri has an update on jenkins slaves 14:06:30 just curious how we feel about our hosting right now - getting better, worse, same, what's next? 14:06:35 here it looks like ovirtbot has ops 14:06:41 eedri: go ahead 14:06:47 RobertM: mind giving it ops just to be sure? 14:07:05 i finally managed to test having headless jenkins slave from home and it worked 14:07:21 it means jenkins can handle slaves without needing access to them 14:07:46 so basicly anyone from the community that wants to contribute a server can, without opening ports for jenkins.ovirt.org 14:08:10 ewoud, ovirtbot has ops 14:08:32 RobertM: it might be unsynced, doesn't set the topic 14:08:35 it just need to be able to connect to jenkins.ovirt.org with a jnlp port, and infra to create a new slave entry in jenkins with the same name 14:08:59 * mburns just got pulled into a call, ping directly if you want my input... 14:09:10 so, it might be a good idea to publish this on wiki or devel list.. 14:09:29 in case someone will want to contribute a new server, especially for other linux flavors 14:09:48 eedri: can you write up a wiki page, then post about it to arch@? 14:09:57 quaid, sure 14:10:11 quaid, add action? 14:10:46 #action eedri to write up wiki page about connecting to jenkins.ovirt.org with a jnlp port; post page to arch@ 14:11:11 #chair eedri RobertM ewoud mburns 14:11:23 huh, very quiet for a bot 14:11:38 i think we can summarize the repo task 14:11:51 Looks like something isn't right with oVirt Bot 14:11:55 * quaid sees logging is working, though 14:12:21 RobertM: the IRC log is being made, so it's probably ok, maybe we can jiggle with it after the meeting 14:12:31 quaid, +1 14:12:52 #chair eedri 14:13:12 eedri: do we have some sort of list of the servers we inted to put as jenkins slaves? 14:13:15 eedri, with some help from rmiddle have files being copied from Jenkins to www.ovirt.org 14:13:33 mgoldboi, we have 1 server in potential, not ready for use yet 14:13:51 mgoldboi, the idea is to present this option to community, and see if anyone wants to contribute 14:14:01 mgoldboi, should be easier now without the security concern 14:14:32 i want to update on the sync files and state remainig tasls 14:14:36 tasks 14:14:53 mgoldboi, I think we really need to get puppet setup and running before getting many new servers added. I created two this week and they were a painful to get running infact I still have 1 set of jobs failing 14:15:04 +1 on that 14:15:29 RobertM: any progress on having a puppet master on our domain? 14:15:35 RobertM, thought i occured to me now that we won't be able to run puppet on these headless slaved 14:15:49 mgoldboi, i think ewoud took lead on that 14:16:05 mgoldboi, ewoud is working on puppet. 14:16:25 currently I've only looked at writing puppet classes, though at my employer I'm working on a project involving puppet masters and foreman 14:16:30 brb 14:16:37 which has a deadline tomorrow, which is why I'm semi afk 14:17:52 should we try to list out all the remaining tasks? I think that's what eedri just suggested above 14:17:54 * eedri here 14:18:12 quaid, i want to close up on the sync task 14:18:35 quaid, i think we have all the nessasary steps agreed upon 14:18:58 how do I send ctrl-alt-del to a VM over spice? :/ 14:19:34 eedri: ah, ok 14:19:59 ok 14:20:02 mgoldboi: btw, would you be interested in working with puppet as well? because in that case I'll try to hurry with sharing what I've done so far 14:20:28 so far we have jobs per project that creates tar.gz + rpm + src.rpms here http://jenkins.ovirt.org/view/rpms/ 14:20:43 ewoud: sure, please send it over, will be happy to asist 14:20:50 we'll need to add more ovirt projects there if we want 14:21:30 publish job collects all those artifacts and (agreed in email) on where and how it will be deployed on ovirt.org server 14:21:48 unless there are objections to it.. 14:22:41 so as i see it, the only action left is the create a cron task on ovirt.org 14:23:04 that will copy the nightly artifacts,createrepo and delete old artifacts 14:23:06 eedri, We all agree on the end results I think between the two of use we can hammer out the little details 14:23:06 mgoldboi: will do 14:23:19 RobertM, can you take on the cron job?> 14:23:31 RobertM, i'll finish up the work on the jenkins jobs 14:24:14 eedri, no problem 14:24:18 RobertM, ok, so that's setteled 14:24:23 ok 14:24:24 quaid, you can move to the next item 14:24:34 anything morea bout Jenkins? 14:24:38 sure 14:24:45 #topic Jenkins 14:24:48 #action rmiddle and eedir to finish up auto nightly repo this week. 14:25:21 i'm not sure we agreed on the flow for approving gerrit triggered jobs for commiters 14:26:12 We haven't mainly because we aren't sure how to implant trusted vs untrusted users. 14:27:15 quaid, any insight on that? 14:28:06 hmm 14:28:34 that's probably a debate to finalize on the list, then? 14:28:45 yes 14:29:07 I thought we were leaning toward a whitelist, pulled from existing committers 14:29:33 Just need to restart the incomplete one from the infra list. 14:29:43 quaid: that was the direction last meeting 14:29:48 quaid, Yes 14:30:15 we can take current commiters from git log 14:30:22 and make an initial whitelist from it 14:30:59 exactly 14:31:27 I wasn't sure how do to that in Jenkins. 14:31:48 RobertM, i think once the whitelist is on a public wiki page, we can wget it 14:31:53 ok, I'll reply to the initial thread with this latest proposal/discussion level 14:32:06 RobertM, and compare it with the current GERRIT_AUTHOR or similar value 14:34:12 eedri, I think that is what we were thinking of 14:34:22 ok 14:34:34 * quaid thinks this topic is exhausted here for now 14:34:38 RobertM, ok, let's do some tests on jenkins info with that 14:34:45 quaid, +1 14:34:52 do we have any other topics left from last week? 14:35:05 Moving Jenkins Master off EC2 14:35:17 #topic moving Jenkins master off EC2 14:35:48 Jenkins master is IO bond badly and that is slowing down everything. 14:36:39 My two test boxes are running jobs twice as fast and jenkins.ovirt.org 14:37:05 * mgoldboi have to pull away, will catch up later 14:37:10 +1 on that 14:37:20 jenkins.ovirt.org is very very slow 14:37:30 ok, so this is the hosting question 14:37:49 I've been confused if we need to continue pursuing a stand-alone host for Jenkins master 14:37:57 but it sounds like we do 14:38:29 quaid, We need a standalone host for Jenkins Master 100X more then we need more slaves. 14:38:44 how about we discuss (on list) some hosting options we like, and see if we can get that finished ASAP, maybe by end of week? 14:39:17 RobertM, it's different needs, but yes. jenkins master should be a decent server, especially if i'ts going to scale soon 14:39:19 with new jobs 14:39:22 and slaves 14:39:28 quaid, We can simple convert to using jenkins.ovirt.info and add a cname for the current site. 14:39:49 quaid, i think hosting might cost even less than the ec2 vms? 14:39:52 RobertM: that's a good suggestion 14:39:56 Until we can get real hardware support from Redhat. 14:39:57 eedri: 10x less, most likely 14:40:47 I'll start the thread, RobertM can throw in his suggesting to us ovirt.info, and we can see how that looks compared to some other favorite dedicated hosting providers 14:41:17 #action quaid to start thread on finishing the Get Jenkins a New Host discussion, so we can pick a hosting solution and move ASAP 14:41:57 quaid, OK. 14:43:02 #topic Anything else? 14:43:23 Jenkins backups have been running for close to a week 14:43:40 Took 16G for last night backup and 30G total space is in use. 14:44:45 Also I build a testing Jenkins server hosed at jenkins.ovirt.info also as a method for testing DR on jenkins 14:44:57 +1, very useful for testing stuff 14:45:16 RobertM, you also updated jenkins.ovirt.org & plugins 14:45:39 eedri, Yes forgot to mention that. 14:46:11 RobertM, looks like it solved the 'more' bug 14:46:27 Yep 14:47:09 Also seems to have lowered the load some. Very important since Jenkins Master is so overloaded. 14:49:10 danken2, is danken1 around? 14:52:24 quaid, i think we can close the meeting for now? 14:52:29 yes 14:52:40 #endmeeting 14:52:46 oh dear 14:53:04 * quaid looks in directories 14:53:36 the log is still running 14:53:41 http://ovirt.org/meetings/ovirt/2012/ovirt.2012-07-31-14.01.log.txt 14:54:03 restart the bot should end the meeting 14:54:10 I wonder if my nick change messed things up 14:54:22 Likwly 14:54:23 RobertM: won't we lose the incomplete actions, etc.? 14:54:26 Likely 14:55:08 Only other thing to try is to switch back to the other user and end that way. 14:55:39 * quaid trying that 14:55:47 But since you set the chair after the renew it likely ingoroed all the commands. 14:55:59 well, it didn't ignore the actions 14:56:04 because anyone can set those 14:56:07 but we can just extract 14:57:02 * mburns notes that it worked fine for me when i ran a meeting at 9 14:57:19 yeah, it's because of the nick change, I'm sure 14:57:33 gotta go 14:57:36 ciao 14:57:44 eedri, Night 14:57:45 RobertM, i'll catch you later for the sync 14:57:55 eedri, Ok 14:59:02 I'm going to try restarting myself first 15:00:58 whoops, -HUP worked the first time :) 15:02:17 omg, it's still logging