Jordan Westhoff

Jordan Westhoff's Blog


Leave a comment

Senior Project Update 7/9/2014 – New Servers, Testing and Accelerated Deployment

Hey all,

Summer has been awesome here in Rochester so far, I’ve gotten a lot done in different regards to my project!

Ultimately, I’m still in the stage of hardware and software testing, while conducting studies on 4K formats and compression schemes. All of this is valuable in appraising how much computational power I need to conduct all of the operations that are required to get the 4K footage processed as quickly as possible. Since I last posted, I’ve gotten some additional hardware to use and test, both virtually and locally. Here’s the round up of some stuff:

For the record, ALL of my Senior Project Updates can be found here, on my Senior Project Page

Last Post:

Last post, I was comparing smaller, underpowered machines to massive computing desktops to see what the differences were. They were, well, humongous. It turns out the small Micro-ITX board and setup I was using is indeed too slow for any kind of operations work. Hence, I re-purposed it for something that is different, but still useful: a netflix box!

The Alienware machine is a powerhouse even though it is still pretty old. Once I stocked it with a powerful GPU and added a bit more ram (went from 2 to 18 GB of RAM). Right now it is conducting CPU vs GPU testing as well as being used as a primary gaming machine in the evenings when I get back from work on campus. Overall, the Alienware definitely did win the battle between light and power efficient vs power hungry and high performance.

New Information:

Okay here’s all the new stuff that I promised. Recently, the school granted me two more physical server machines for use on the project. Both are 64 bit SuperMicro 2U servers, both are taking advantage of AMD’s Opteron processing technology, which I have to admit, is awesome. Both machines are powered by dual quad core CPU’s and 64GB’s of RAM.

10455181_10204248995689261_6823904756187854118_n

One of my new SuperMicro machines waiting to be racked with two of my other, older Dell units.

One of the new devices is posted in the photo, it’s the machine on top and there is a second one that is identical but I already had it racked at the time the photo was taken. As you can see, both have considerably larger drive quantities. Each unit allows me to store 8 drives, and currently both have 15K raptor drives included which is awesome! 15K server drives, which I have RAIDed (laymans term for working in tandem to increase speed) is allowing me to exceed a standard hard drive read and write speed by a factor of 3! This will be invaluable for parsing and spreading out frames for my project across the cluster. Right now, each of the drives is writing at a ballpark of 82 MB/s and reading at a rate of about 260 – 280 MB/s. This is excellent because for the system I am building, read speed are far more important than write speeds for these two units. Write speeds will increase as I RAID the devices.

On top of this, I have been developing a lot of the skeleton dev software for my project. The first stage of this has been individually configuring each server since I haven’t decided to go with a major software solution like Puppet, Salt or Ansible since I’m not sure that all of the configuration time is worth the slight performance boost I would get during only the configuration phase of each server. As a result, I’ve written a full suite of scripts that kick into effect once cent is installed on each machine. I decided to go with CentOS since it focuses on enterprise support, security and longevity (the current cent dystro is supported for 7 years). Once an OS is installed, each machine can run totally autonomously once it connects to my authentication and has all of the account info it needs. The machines install all of the necessary programs and services, in addition to syncing other repositories and cloning them locally . Once each of them is all setup, it notifies me via log that it is ready to join the cluster and processing can begin. As I begin to amass more and more hardware, local and virtual, easier deployment of each unit is increasingly more important because once the semester begins again, it will be very difficult to gather extra time to set up more efficient configurations and whatnot.

In the next week or so, I should be getting access to more hardware, I also have a lot of cool code to share with you all; most of it is linux based deployment, disk testing and a variety of others as well. Look for that in my Git and other repos, hosted here!

 

 

Advertisements


Leave a comment

Summer Updates

Hey everybody!

So, over the last couple of evenings I’ve spent a good deal of time updating the site! I”ve added new content, a couple new pages, and most importantly of all, began posting content from Spring semester! There’s a lot going on here so let me break down all of the updates for you!

 

Third Year MPS Camera Shootout!

So this is the first big one! If you head over to my page under projects, you’ll see the page for the MPS Shootout! This is a whopper and all of the content from the shoots, uncluding b-roll, final analysis and our final video screened for all of RIT’s film school is posted. There’s a lot of information here, and if you’ve followed along at all, it should be pretty exciting. I found it easier to turn it into a whole page, rather than a post so it can house more information as well as be easier to find later as more posts pile up!

Raw & Order Shootout

 

Senior Thesis Project Update #1

The page is finally live! I have some updates to publish tomorrow so stay tuned for those! If you follow the header, it will take you to the landing page for my senior thesis project – this sucker is being researched over the summer and then the completion of research and the beginning stages of engineering will start in the fall! I’m still working on populating the page with information about the initial ideals and concepts of the project but those will be up soon as well!

alienware

 

GitHub!

As a lot of you know, I’ve recently moved over to doing all of my code versioning and revision tracking via GitHub and I think it’s pretty cool! I’ve started a couple of pages within this site to either pull from Gists that I’m working on or completed that I want to show you or from actual Git hub repos. Basic Gists can be found here and the rest of my stuff can be found on my actual GitHub page for now!

git

 

Thanks for catching up, be sure to check back to the pages as I’m adding more posts!