This past semester, a co-worker and I sponsored a student project at NCSU. Basically it was just a tool to do some number crunching to look for unusual behavior based on a user specified tolerance level.
At first the team thought this was too simple a project and not that interesting. But when we pointed out to them that their data source was typically 20gb or more and there's no way they could possibly keep all their intermediary calculations in memory at once they got kinda big-eyed.
In the end they came through with flying colors thanks to some mentoring from my co-worker T. I think it was the heftiest piece of design they'd ever done.
![[personal profile]](https://www.dreamwidth.org/img/silk/identity/user.png){kind=small}
heh
Date: 2005-05-28 07:27 pm (UTC)At first the team thought this was too simple a project and not that interesting. But when we pointed out to them that their data source was typically 20gb or more and there's no way they could possibly keep all their intermediary calculations in memory at once they got kinda big-eyed.
In the end they came through with flying colors thanks to some mentoring from my co-worker T. I think it was the heftiest piece of design they'd ever done.