November 21, 2008

Installing Splunk Part 1 of 5 – Starting the OS Installation

For the purpose of this blog series I am going to go through installing the operating
system for Splunk. Installing Splunk, then configuring both the OS and Splunk
for managing the logs within your environment. The operating system that I have
chosen in Suse Enterprise 10. My goal in this blog series is to provide a step
by step installation guide and configuration guide. While you will not be either
a Splunk expert or a Linux expert after reading this series you will be able to forward,
maintain, and take care of the logs within your environment.

I chose to use Suse for the installation for two reasons. First I wanted the
smallest footprint from the operating system as I could achieve so Linux was the obvious
choice. Second, and more specifically, I chose Suse because of my familiarity
with the OS and the ability to use Yast for installing additional packages if needed.
this could be tweaked for other Linux installations.

Installing the operating system. I didn’t take the time to add fluff or colorful
commentary to this installation guide. It is for those out there that want a
straightforward, get it done, guide.

  1. Ensure that your server is configured
    for RAID 10 or RAID 0+1. When introducing a log management server of any kind
    redundancy and having the ability to recover from hardware failure is crucial.
    I would recommend RAID 10 as it provides good performance while providing the needed
    redundancy. If you are not familiar with RAID or it’s configuration then here is
    a reference for you to look at.
  2. Ensure that the amount of RAM
    that is installed on the server is written down as it will be needed later in this
    document.
  3. After rebooting the server you
    should be able to see the following screen.
  1. From the screen above (Step 3.),
    select Installation and press enter. The installation will take a few minutes to load.
  1. Select your preferred language
    and click Next.
  1. Click on “Yes, I Agree to the
    License Agreement” and click Next.
  1. Make sure that “New Installation” is selected and click Next.
  1. Select the preferred Region and
    Time Zone and click Next.
  1. Select the Expert tab to select
    a secure installation method.
  1. Click on Partitioning and select
    Create Custom Partition Setup.
  1. The next screen will prompt you
    to select the drive to install on. Select the primary
    hard drive/RAID array that will be used.
  1. Once Presented with the expert
    options screen delete all of the presented partitions. Until
    only SDA remains.

At this point the process for creating multiple partitions becomes repetitive so i will only show images for the first partition after that I am going to assume that you can scroll back to the images if needed. Also note that the partition sizes vary from the images to the instructions. The key is to follow the instructions and use the pics only for reference. It goes without saying that at a minimum you should have 100gb of hard drive space for the server in a small at home environment and more than a terabyte within an enterprise environment. The key is to follow the instructions and save room for /opt as it will be the Splunk partition.

  1. At the bottom of the screen click
    the button for Create, to create a new partition and select Primary Partition from
    the Pop-Up Window.
  1. The next Pop-Up window will format
    the partition and place the mount point. On left side
    select Ext3 for the file system type. On the Right Side
    click inside the ending point of the partition and type “+20gb”. On
    the bottom right select “/” and click “OK” and the new partition will be displayed
    at the top of the screen.
  1. At the bottom of the screen click
    the button for Create, to create a new partition.
  2. Select Primary Partition from
    the Pop-Up Window
  3. On left side select Ext3 for
    the file system type
  4. On the Right Side click inside
    the ending point of the partition and type “+200mb”
  5. On the bottom right select “/boot”
    and click “OK” and the new partition will be displayed at the top of the screen.
  6. At the bottom of the screen click
    the button for Create, to create a new partition.
  7. Select Primary Partition from
    the Pop-Up Window
  8. On left side select Swap for
    the file system type
  9. On the Right Side click inside
    the ending point of the partition and type “+XYZgb” where XYZ is the same number as
    the system RAM gathered in step 2.
  10. Click “OK” and the new partition
    will be displayed at the top of the screen.
  11. At the bottom of the screen click
    the button for Create, to create a new partition.
  12. Select Extended Partition from
    the Pop-Up Window
  13. Ensure that all remaining portions
    of the drive are selected in the window. Click “OK” and
    the new partition will be displayed at the top of the screen.
  14. At the bottom of the screen click
    the button for Create, to create a new partition.
  15. The next Pop-Up window will format
    the partition and place the mount point.
  16. On left side select Ext3 for
    the file system type
  17. On the Right Side click inside
    the ending point of the partition and type “+5gb”
  18. On the bottom right select “/usr”
    and click “OK” and the new partition will be displayed at the top of the screen.
  19. At the bottom of the screen click
    the button for Create, to create a new partition.
  20. The next Pop-Up window will format
    the partition and place the mount point.
  21. On left side select Ext3 for
    the file system type
  22. On the Right Side click inside
    the ending point of the partition and type “+5gb”
  23. On the bottom right select “/var”
    and click “OK” and the new partition will be displayed at the top of the screen.
  24. At the bottom of the screen click
    the button for Create, to create a new partition.
  25. The next Pop-Up window will format
    the partition and place the mount point.
  26. On left side select Ext3 for
    the file system type
  27. On the Right Side click inside
    the ending point of the partition and type “+10gb”
  28. On the bottom right select “/home”
    and click “OK” and the new partition will be displayed at the top of the screen.
  29. At the bottom of the screen click
    the button for Create, to create a new partition.
  30. The next Pop-Up window will format
    the partition and place the mount point.
  31. On left side select Ext3 for
    the file system type
  32. On the Right Side click inside
    the ending point of the partition and type “+2gb”
  33. On the bottom right select “/tmp”
    and click “OK” and the new partition will be displayed at the top of the screen.
  34. At the bottom of the screen click
    the button for Create, to create a new partition.
  35. The next Pop-Up window will format
    the partition and place the mount point.
  36. On left side select Ext3 for
    the file system type
  37. On the Right Side by default
    the remaining portion of the drive should be selected. Ensure
    that all remaining drive space is allocated to this partition.
  38. On the bottom right select “/opt”
    and click “OK” and the new partition will be displayed at the top of the screen. The
    partition table should resemble that of the following figure.
  1. Click “Finish” on the bottom
    right of the screen
  2. This will bring you back to the
    installation summary page.

At this time due to size and to keep the post a reasonable length
we are going to break up the blog posts for clarity and you can go to part
2 of 5 to go through the next portion of the installation.