[Sidefx-houdini-list] network bgeo generation vs local

Francois Duchesneau sidefx at trinix.ca
Tue Jul 20 14:29:58 EDT 2010


Thanks for the test on Linux. Here are the result of my test with a bad
formating :(

It's indeed especially true when I deal with millions of particles. I
start thinking I may let my IFDs and cache bgeo local and make that big
local drive available to the network. I don't think the it guy will want
that and I know there are drawbacks about that but it deserves thinking
about it more.

Of course only temp data would be there and my hip, tex etc file would
stay on the network.

Number of Points	bgeo	bgeo.gz	bgeo net	bgeo.gz net	copy local bgeo to
net	size bgeo	size bgeo.gz	ifd	ifd net	copy local ifd to net
50000	0 sec.	5 sec.
100000	0 sec.	10 sec.	9 sec.	17 sec.
200000	1 sec.	20 sec.	20 sec.	32 sec.	5 sec.	3 MB	1.5 MB	3 sec.	17 sec.	5
sec.
400000	2 sec.	40 sec.	41 sec.	72 sec.	13 sec.	6.1 MB	3 MB	4 sec.	34
sec.	10 sec.
800000	7 sec.	80 sec.	105 sec.	130 sec.	22 sec.	12.2 MB	6 MB	8 sec.	60
sec.	14 sec.
1600000	8 sec.	160 sec.	131 sec.	245 sec.	40 sec.	24.4 MB	11.8 MB	12
sec.	144 sec.	39 sec.
400000 Cd	5 sec.	56 sec.
400000 N	5 sec.	56 sec.
400000 Cd N	6 sec.	75 sec.
400000 Cd N up	8 sec.	94 sec.
400000 scale	4 sec.	46 sec.
400000 scale Mass Drag	7 sec.	59 sec.

>   Did a test on Linux and the same issue. Network writing is a lot slower
> than
> writing locally (factor 2). But if i add the copy/move time the difference
> per
> file is smaller. The network writing cost around 27seconds to perform, the
> local
> writing plus copy 22 seconds. The time might be dependant on the size of
> the
> bgeo (52mb file here), not sure if it has impact on the performance .
>
> Hans
>
> On 07/20/2010 04:38 PM, Francois Duchesneau wrote:
>> I've done some benchmarks regarding working local vs network for file
>> generation and I've come with those results.
>>
>> 131 sec. to bake a bgeo file on the network vs 8 sec. locally. To copy
>> the
>> local file to the network takes 40 sec.
>>
>> So what I do know is to bake locally and copy to save time. Before I
>> create a pipeline for that I was wondering if others have dealt with
>> that
>> and how. Is there an option? Is that issue only on Windows.
>>
>> François
>>
>> _______________________________________________
>> Sidefx-houdini-list mailing list
>> Sidefx-houdini-list at sidefx.com
>> https://lists.sidefx.com:443/mailman/listinfo/sidefx-houdini-list
>>
>>
>
> _______________________________________________
> Sidefx-houdini-list mailing list
> Sidefx-houdini-list at sidefx.com
> https://lists.sidefx.com:443/mailman/listinfo/sidefx-houdini-list
>





More information about the Sidefx-houdini-list mailing list