[Sidefx-houdini-list] Mantra farm rendering to server killing network, ideas?

Matt Estela matt.estela at gmail.com
Mon Sep 8 05:29:48 EDT 2014


Yep, that's what this looks like. Ebb is here and made pained expressions
when we realized what the problem was, said the penguin based solution was
a bit hacky.

Had hoped a more elegant solution had been hit upon since those dark dark
days. :)
On 08/09/2014 6:52 PM, "Ron Schab" <ron.schab at gmail.com> wrote:

> Hey Matt,
>
> Hope things are well.
>
> If I am not mistaken we had a similar issue  at that place where they
> emulated those freezing temperatures Mumble, Sven and all them had to face
> for us artists at our desks despite the fact of us working in Sydney ;)
> I can't quite remember the exact reason then nor the exact solution but we
> - the volumetrics team - caused heavy filer loads with some renders/sims as
> well and had to fix a similar issue.  I believe it had more to do with
> heavy read/write access rather then filesize.  I THINK the solution was a
> tick box on render submission telling the farm to write to the blade's
> local storage first and then triggering a separate job to copy the finished
> file over to its final destination afterwards.  If you are in touch with
> DanB he probably remembers more in depth.  Also I think Matt Ebb would too
> :).  Good luck and have fun.
> Cheers
> Ron
> On Sep 8, 2014 9:46 AM, "Matt Estela" <matt.estela at gmail.com> wrote:
>
> > Curious if anyone else has suffered this sort of thing;
> >
> > We sent a Mantra job to the farm, relatively fast per-frame times, but
> deep
> > exr's with lots of layers meaning it came in at around 120mb per frame.
> > When this was rendered by lots of farm machines at once (like 200 or
> more),
> > this was enough to bring the filer to its knees, lots of fingers pointed,
> > sad sysadmins.
> >
> > I know we've rendered stuff heavier than this before with PRman. Turns
> out
> > this problem had been identified and fixed a while ago, in that our Maya
> > PRman jobs automatically render to the local scratch disk locally per
> farm
> > machine, then copy the frame to the filer when done, keeping the network
> > happy.
> >
> > Anyone implemented such a thing in Mantra? Or know of mystery Mantra
> > options to force it to keep its network write operations to a minimum?
> >
> >
> > -matt
> > _______________________________________________
> > Sidefx-houdini-list mailing list
> > Sidefx-houdini-list at sidefx.com
> > https://lists.sidefx.com:443/mailman/listinfo/sidefx-houdini-list
> >
> _______________________________________________
> Sidefx-houdini-list mailing list
> Sidefx-houdini-list at sidefx.com
> https://lists.sidefx.com:443/mailman/listinfo/sidefx-houdini-list
>



More information about the Sidefx-houdini-list mailing list