System Monitoring with Xymon/Developer Guide
Getting Started with hobbit development on sourceforge
[edit | edit source]Reference Books
[edit | edit source]- C Programming
- UNIX Advance programming
- UNIX Network Programming
SVN tutorial
[edit | edit source]References
[edit | edit source]SVN for Xymon Tutorials
[edit | edit source]Followings are some examples using svn to interact with hobbit on sourceforge.net.
- list out the sub directory of xymon SVN directory.
[tjyang@ibm hobbitmon]$ svn ls https://hobbitmon.svn.sourceforge.net/svnroot/hobbitmon branches/ sandbox/ tags/ trunk/ [tjyang@ibm hobbitmon]$
- find out changes in last 7 days.
[tjyang@ibm hobbitmon]$ svn log -v -r HEAD:\{`date +%Y-%m-%d -d'7 days ago'`\} \
https://hobbitmon.svn.sourceforge.net/svnroot/hobbitmon
------------------------------------------------------------------------
r6033 | storner | 2009-01-08 07:43:23 -0600 (Thu, 08 Jan 2009) | 1 line
Changed paths:
M /trunk/client/Makefile
Make sure client scripts are executable
------------------------------------------------------------------------
r6032 | storner | 2009-01-07 06:00:45 -0600 (Wed, 07 Jan 2009) | 1 line
Changed paths:
M /branches/4.2.3/build/md5.dat
A /branches/4.2.3/hobbitd/webfiles/hostlist_footer
A /branches/4.2.3/hobbitd/webfiles/hostlist_form
A /branches/4.2.3/hobbitd/webfiles/hostlist_header
M /branches/4.2.3/lib/headfoot.c
M /branches/4.2.3/lib/headfoot.h
M /branches/4.2.3/web/Makefile
A /branches/4.2.3/web/hobbit-hostlist.c
A /branches/4.2.3/web/hobbit-hostlist.sh.DIST
Added hostlist CGI from trunk
------------------------------------------------------------------------
r6031 | storner | 2009-01-07 05:59:22 -0600 (Wed, 07 Jan 2009) | 2 lines
Changed paths:
M /branches/4.2.3/build/generate-md5.sh
Adapted to work with Subversion and new source directories.
------------------------------------------------------------------------
r6030 | storner | 2008-12-17 05:39:49 -0600 (Wed, 17 Dec 2008) | 2 lines
Changed paths:
A /branches/4.2.3 (from /branches/4.2.2:6029)
New branch off the 4.2.2 release for maintenance - will become 4.2.3 (if needed).
------------------------------------------------------------------------
[tjyang@ibm hobbitmon]$
- Checking out hobbit source tree using svn.
[tjyang@fc6 ]$ svn co https://hobbitmon.svn.sourceforge.net/svnroot/hobbitmon hobbitmon <snip> A hobbitmon/tags/rel_4_0-20041201/web/bb-findhost.cgi.1 A hobbitmon/tags/rel_4_0-20041201/web/bb-ack.c A hobbitmon/tags/rel_4_0-20041201/web/hobbitsvc-trends.c A hobbitmon/tags/rel_4_0-20041201/web/bb-snapshot.c A hobbitmon/tags/rel_4_0-20041201/web/hobbitsvc.c A hobbitmon/tags/rel_4_0-20041201/web/bb-eventlog.cgi.1 A hobbitmon/tags/rel_4_0-20041201/web/bb-rep.cgi.1 A hobbitmon/tags/rel_4_0-20041201/web/bb-replog.cgi.1 A hobbitmon/tags/rel_4_0-20041201/web/bb-hist.c A hobbitmon/tags/rel_4_0-20041201/web/bb-csvinfo.c A hobbitmon/tags/rel_4_0-20041201/web/bb-webpage.c Checked out revision 5644. [tjyang@fc6 hobbitmon]$ ls -la total 28 drwxrwxr-x 6 tjyang tjyang 4096 Aug 4 09:11 . drwxr-xr-x 38 tjyang tjyang 4096 Aug 4 09:09 .. drwxrwxr-x 3 tjyang tjyang 4096 Aug 4 09:11 branches drwxrwxr-x 6 tjyang tjyang 4096 Aug 4 10:04 .svn drwxrwxr-x 67 tjyang tjyang 4096 Aug 4 10:04 tags drwxrwxr-x 16 tjyang tjyang 4096 Aug 4 09:11 trunk [tjyang@fc6 hobbitmon]$ to revert all the changes you made to hobbit src tree. svn revert --recursive .
- As one of hobbit developers, you can create a branch.
- Following example create a instance of hobbit by tjyang.
[tjyang@fc6 hobbitmon]$ svn mkdir branches/tjyang A branches/tjyang [tjyang@fc6 hobbitmon]$ svn copy trunk branches/tjyang A branches/tjyang/trunk [tjyang@fc6 hobbitmon]$ svn commit -m "T.J. Yang's copy of hobbit" Authentication realm: <https://hobbitmon.svn.sourceforge.net:443> SourceForge Subversion area Password for 'tjyang': Adding branches/tjyang Adding branches/tjyang/trunk Committed revision 5645. [tjyang@fc6 hobbitmon]$
- creating a subdirectory.
[tjyang@fc6 trunk]$ svn status A pkg M README [tjyang@fc6 trunk]$ mkdir pkg/tww [tjyang@fc6 trunk]$ svn status ? pkg/tww A pkg M README [tjyang@fc6 trunk]$ svn add pkg/tww A pkg/tww [tjyang@fc6 trunk]$ pwd /home/tjyang/hobbitmon/branches/tjyang/trunk [tjyang@fc6 trunk]$ ls bbdisplay bbproxy Changes common configure.client COPYING debian hobbitd lib README RELEASENOTES web bbnet build client configure configure.server CREDITS docs include pkg README.CLIENT rpm [tjyang@fc6 trunk]$ pwd /home/tjyang/hobbitmon/branches/tjyang/trunk [tjyang@fc6 trunk]$ ls bbdisplay bbproxy Changes common configure.client COPYING debian hobbitd lib README RELEASENOTES web bbnet build client configure configure.server CREDITS docs include pkg README.CLIENT rpm [tjyang@fc6 trunk]$ ls bbdisplay bbproxy Changes common configure.client COPYING debian hobbitd lib README RELEASENOTES web bbnet build client configure configure.server CREDITS docs include pkg README.CLIENT rpm [tjyang@fc6 trunk]$ history |grep commit 1159 svn commit -m "T.J. Yang's copy of hobbit" 1217 history |grep commit 1240 history |grep commit [tjyang@fc6 trunk]$ svn commit -m "add pkg directory" Sending trunk/README Adding trunk/pkg Adding trunk/pkg/tww Transmitting file data . Committed revision 5646. [tjyang@fc6 trunk]$
Development Road Map
[edit | edit source]Henrik, Feb 9 2009
[edit | edit source]On February 9, Henrik posted the following roadmap to the list. I haven't heard much lately so I don't know if it has changed.
Version 4.4:
- SNMP support for data collection
- Status updates based on data collected in the RRD files (this is really nice - essentially, *any* value you put into an RRD file can trigger a new or modified status in Xymon. So you could eg. change the status of your "http" test to go red, if the response time of a webpage exceeds 5 seconds).
- Status "flap" handling, to catch statuses that change rapidly.
Version 4.5:
- Support for communication between clients and Xymon to use compression and/or encryption.
- Support for client authentication via SSL certificates (so you cannot spoof a client message).
Version 4.6:
- Revised web interface - eliminate the need for webserver-based authentication, and provide more fine-grained authorization for the various Xymon components.
- Per-user custom login pages, so the login will always show those systems that the user has responsibility for / is allowed to access.
Somewhere along the road I will also introduce a new "ping" test daemon - I am getting to the point where ping'ing all hosts take longer than 5 minutes (I have a lot of hosts). So something needs to be done, and I think I know how to do it.
Changes
[edit | edit source]Todos
[edit | edit source]Tasks that most team member agree to implement.
Design Document
[edit | edit source]Wish Lists
[edit | edit source]- Test Suite for software quality assurance.
- Migrate all the bb modules from deadcat.net to hobbit.
- SLA Report built in.
- Better Theme support.
- Provide encrypted communication pipe between hobbit server and hobbit client.
- hobbit messages compression.
- ipv6
- 4.2.x maintenance release.
- Rewrite of the alerts module to work properly. ;) It's quite flawed at the moment.
Xymon volunteers Roles and Responsibility
[edit | edit source]This is a list of people offer their time and skill to Xymon community in following areas of R&R.
- Project Admin
- Has right as project admin on sourceforge.
- Assign tickets to different persons listed below.
- Grant new developer privilege on sourceforge.
- Get people to work as a team with limited and un-paid resources.
- Development
- Understand Xymon source tree.
- Do source code documentation.
- Work on ticket from issue tracker.
- Apply patches submitted from the Xymon community.
- Implement new requested features
- Documentation
- Keep troff files updated with Xymon features.
- maintain troff2html process.
- Create a publish-grade manuals and process for Xymon using Latex.
- use latex2troff tool to generate Xymon troff manpage sources.
- Automate the document generation in "make" command process.
- Keep troff files updated with Xymon features.
- End User Support
- Answer questions raised in xymon user email list.
- Maintain Xymon FAQ.
- Test out new Xymon features or verify a bug.
- Module Development
- Write new Xymon client external modules.
- Write Xymon Server side external modules.
- Maintain orphan Xymon modules.
- Maintain Xymon module development guides.
| Name | Project Admin | Development | Documentation | End User Support | Module Development |
|---|---|---|---|---|---|
| Henrik Størner | Yes | ||||
| T.J. Yang | Yes | Yes | Yes | ||
| Jerald Sheets | Yes | ||||
| Josh Luthman | |||||
| Malcolm Hunter | Yes | Yes | |||
| Japheth J.C. Cleaver | |||||
| Steve Holmes | Y | Y | ? | ||
| Damien Martins (aka doctor madness) | N | Y | Y | N | |
| dubby | Yes | ||||
| Flemming | Yes | ||||
| Christoph Berg | Yes | Yes | |||
| Vadim Pushkin | Yes | ||||
| Martin Ward | Yes | ||||
| Buchan Milne | Yes | ||||
| Rich Smrcina | Yes | ||||
| Kenneth Langford | Yes | ||||
| Padraig Lennon | |||||
| David Baldwin | Yes | ||||
| Ralph Mitchell | Yes | Yes | |||
| Dummy Template Replace Here | Admin Y/N | Dev Y/N | Doc Y/N | User Support Y/N | Module devel Y/N |
| Olivier AUDRY | Yes | Yes | |||
| Neil Franken | Yes | Yes | |||
| Peter Toft |
Packager Who is who
[edit | edit source]- blingme: Mandriva
- Christoph Berg (Myon): debian
Developers Who is who
[edit | edit source]- Henrik Stoerner: http://www.hswn.dk
- Make Big Brother system monitor to be open again.
- Rewrite Big Brother shell scrip part into C code to speed up the performance.
- Amazon Wish List
- Rich Smrcina
- Buchan Milne
- T.J. Yang
- hobbit wiki book project.
- Autoconfiscate Hobbit.
- Hobbit documentation project.
- Will use latex to create hobbit manual.
- Digitation of hobbit software build,package build and deployment process.
- OpenSolaris VMWare appliance for Hobbit Development.
- Using EXTJS 3.0 for hobbit menu system.
Developers
[edit | edit source]- Vernon Everett
- hobbit wiki and documentation.
- Etienne GRIGNON (etienne.grignon@gmail.com )
- Francesco Duranti <fduranti@q8.it>
- Ability to patch hobbit source code.
- http://www.hswn.dk/hobbiton/2006/10/msg00080.html
- TWW Inc.
- Package the hobbit client and server using TWW toolsets.
List of Names contributed to this hobbit project
[edit | edit source]Manon Goo <manon@manon.de> Alex Tang <altitude@cic.net> Tim Hudson (tjh@cryptsoft.com) Steve Reid <steve@edmweb.com> Thomas Roessler <roessler@does-not-exist.org> Wei Dai <weidai@eskimo.com> Eric Young (eay@cryptsoft.com) Charles Goyard <cg@fsck.Fr> Marco Avvisano Paul Backer Olivier Beau Adamets Bluejay Brian Buchanan Massimo Carnevali Douwe Dijkstra Francesco Duranti Lars Ebeling Tom Georgoulias Laurent Grilli Kevin Hanrahan Asif Iqbal Charles Jones Thomas J Jones Uwe Kirbach Joshua Krause Patrick Lin Brian Lynch Thomas Mattsson Michael Fisher Daniel J McDonald Werner Michels Christian Perrier Jure Peternel William Richardson Torsten Richter Chris Ricker Tim Rotunda Thomas Rucker Mirko Saam Thomas Schfer Tom Schmidt Eric Schwimmer Bill Simaz Gavin Stone-Tolcher Jeff Stoner David Stuffle Christian Thibodeau Rick Waegner Rob Watson
Autoconfiscate Hobbit
[edit | edit source]This section describe the conversion of hobbit source tree into autotool control.
Why the autoconfiscation ?
[edit | edit source]- To be more portable across OS platforms.
- Plan for I18n and L10n.
- To become true GNU software which require use of autotool.
Learn autotool
[edit | edit source]- the autotools tutorial and read the pdf slides.
- hand on testing on hello world example.
- example of using autoscan.
Convert hobbit source tree
[edit | edit source]- make sure your autotool sets has following version.
GNU Autoconf 2.61 (November 2006) GNU Automake 1.10 (October 2006) GNU Libtool 1.5.24 (June 2007) GNU Gettext 0.17 (November 2007)
- download the latest hobbit source tar ball.
- run autoscan to get configure.scan and then modify it as configure.ac.
- convert lib/Makefile demotool/Makefile ... etc into Makfile.am.
- Fine tune configure.ac to take configuration options as configure options.
- Support Linux and Solaris OS setting in configure.ac.
References
[edit | edit source]Xymon Documentation
[edit | edit source]- Current
- Henrik Stroner use troff to generate manual pages so that we have the RTFM type of documentation.
- Also troff2html is used to create html page for web browser viewing.
- Enhancements Proposals.
- Use latex+dia+make+wiki to create publishing grade docs
- Use Table of Conetent, index, references and Figures to describe Xymon related topic.
- Generate Xymon User Guide.
- Generate Xymon Developer Guide
- Generate Xymon System Admin Guide.
- Generate Xymon Slide for presentation purpose.
- Use Wiki documentation content incubation.
- Generate html.RTF and pdf for different purpose.
- Request Development Team to use doxygen syntax for source code documentation.
MediaWiki to DocBook
[edit | edit source]- use mvc to gain hobbit wiki source
- convert mediawiki source to latex.
Man pages
[edit | edit source]Reuse content from existing hobbit documentation source
[edit | edit source]Xymon test suite
[edit | edit source]Run through test cases to verify the code changes are ok.
Performance test scripts
[edit | edit source]Quality assurance test scripts
[edit | edit source]shell scripts
[edit | edit source]- test script in build directory of hobbit-4.0.3 to make sure depended software are in build machine.
build/perl.sh build/fping.sh build/rrd.sh build/ssl.sh build/ldap.sh build/pcre.sh
Test script by Perl
[edit | edit source]Test script by Python
[edit | edit source]Test script by DejaGNU
[edit | edit source]Dtrace probes in hobbit server
[edit | edit source]An example of putting dtrace probe int an application.
Packaging
[edit | edit source]Hobbit Client for OpenSolaris IPS format
[edit | edit source]- Features of This hobbit client
- This hobbit client will use a local account and group to avoid NIS and NFS dependency.
- It will use SMF to start/top hobbit client.
- It will use sudo or Solaris 10's ACL to achieve reading restricted information off OpenSolaris.
- hobbit-client-serverconf is simple version of hobbit client without local messages processing.
- hobbit-client-local will do some processing filtering, it need more depended software.
- it use /opt/hobbitclient42 as installation path.
- svcadm disable/enable network:/hobbit-client-serverconf
OpenSolaris info
[edit | edit source]- OpenSolaris 2008.05
-bash-3.2# uname -a
SunOS opensolaris 5.11 snv_86 i86pc i386 i86pc
-bash-3.2# cat /etc/release
Open Solaris 2008.05 snv_86_rc2a X86
Copyright 2008 Sun Microsystems, Inc. All Rights Reserved.
Use is subject to license terms.
Assembled 23 April 2008
-bash-3.2#
- Installed Sun and SUNW gcc-3.4.3 compilers.
- if not installed run "pkg install sunstudioexpress" and "pkg install SUNWgcc".
-bash-3.2# pkg info sunstudioexpress SUNWgcc
Name: sunstudioexpress
Summary: Sun Studio Express - C, C++, & Fortran compilers and Tools
State: Installed
Authority: opensolaris.org (preferred)
Version: 0.2008.5
Build Release: 5.11
Branch: 0.86
Packaging Date: Wed Apr 30 21:10:32 2008
Size: 566.2 MB
FMRI: pkg:/sunstudioexpress@0.2008.5,5.11-0.86:20080430T211032Z
Name: SUNWgcc
Summary: gcc - The GNU C compiler
State: Installed
Authority: opensolaris.org (preferred)
Version: 3.4.3
Build Release: 5.11
Branch: 0.86
Packaging Date: Sat Apr 26 18:22:21 2008
Size: 60.4 MB
FMRI: pkg:/SUNWgcc@3.4.3,5.11-0.86:20080426T182221Z
-bash-3.2#
Using shell script to automate package building
[edit | edit source]RPM
[edit | edit source][root] cat build/makerpm.sh
#!/bin/sh
REL=$1
if [ "$REL" = "" ]; then
echo "Error - missing release number"
exit 1
fi
cd ~/hobbit
rm -rf rpmbuild
# Setup a temp. rpm build directory.
mkdir -p rpmbuild/RPMS rpmbuild/RPMS/i386 rpmbuild/BUILD rpmbuild/SPECS rpmbuild/SRPMS rpmbuild/SOURCES
cat >rpmbuild/.rpmmacros <<EOF1
# Default macros for my enviroment.
%_topdir `pwd`/rpmbuild
%_tmppath /tmp
EOF1
cat >rpmbuild/.rpmrc <<EOF2
# rpmrc
buildarchtranslate: i386: i386
buildarchtranslate: i486: i386
buildarchtranslate: i586: i386
buildarchtranslate: i686: i386
EOF2
cat rpm/hobbit.spec | sed -e "s/@VER@/$REL/g" >rpmbuild/SPECS/hobbit.spec
cp rpm/hobbit-init.d rpmbuild/SOURCES/
cp rpm/hobbit.logrotate rpmbuild/SOURCES/
mkdir -p rpmbuild/hobbit-$REL
for f in bbdisplay bbnet bbpatches bbproxy build common docs hobbitd include lib scripts
do
find $f/ | grep -v RCS | cpio -pdvmu ~/hobbit/rpmbuild/hobbit-$REL/
done
cp -p Changes configure COPYING CREDITS README ~/hobbit/rpmbuild/hobbit-$REL/
find ~/hobbit/rpmbuild/hobbit-$REL -type d|xargs chmod 755
cd rpmbuild
tar zcf SOURCES/hobbit-$REL.tar.gz hobbit-$REL
rm -rf hobbit-$REL
HOME=`pwd` rpmbuild -ba --clean SPECS/hobbit.spec
rpm --addsign RPMS/i?86/hobbit-$REL-*.i?86.rpm
mv RPMS/i?86/hobbit-$REL-*.i?86.rpm SRPMS/hobbit-$REL-*.src.rpm ../rpm/pkg/
[root]
Using CPAM tools to automate package building
[edit | edit source]How to participate the hobbit development
[edit | edit source]- subscribe to hobbit mailing list
- create an account on en.wikibooks.org to participate in hobbit documentation effort.
- learn from http://en.wikibooks.org/wiki/CPAM_with_TWW to participate in hobbit automated cross-platform software packaging effort.
Setup your development environment
[edit | edit source]On OpenSolaris x86
[edit | edit source]Using prebuilt OpenSoalris VMWare Image
[edit | edit source]- Download OpenSolaris VMWare Image from here(TBA).
- Install VMWare player 3.0 from here(TBA).
Using VirtualBox OpenSolaris Image
[edit | edit source]On Solaris 10 Intel
[edit | edit source]- host info
bash-3.00# which cvs /opt/csw/bin/cvs bash-3.00# uname -a SunOS unknown 5.10 Generic i86pc i386 i86pc bash-3.00# which gcc /opt/csw/gcc3/bin/gcc bash-3.00# which gmake /opt/csw/bin/gmake bash-3.00#
On RedHat Linux
[edit | edit source]Setup your TWW developement
[edit | edit source]- download TWW tools onto your system
- compile hobbit*.[sb|pb].
checkout source code from sourceforge.net
[edit | edit source]Read the source codes
[edit | edit source]Feedback to Hobbit
[edit | edit source]- include your fix,patch, modules addition to sourceforge.net
Hobbit Functional diagrams
[edit | edit source]Hobbit server
[edit | edit source]
So the core design looks like this:
Network tests --\
\
TCP:1984 \ IPC
Clients ----------> hobbitd --------> hobbitd_channel ---> worker module
/ Sh. mem. stdin
/
Custom tests ---/
Windows Hobbit client
[edit | edit source]Hobbit Modules Development
[edit | edit source]Developing Hobbit by Existing Internet Development Environment
[edit | edit source]Custom Monitoring Scripts for Hobbit
[edit | edit source]System Monitoring with Hobbit/HOWTO/Custom Monitoring Scripts for Hobbit http://www.hswn.dk/hobbit/help/hobbit-tips.html#scripts
Developing Hobbit by CPAM/TWW Development Environment
[edit | edit source]Why use CPAM/TWW tool ?
[edit | edit source]- Pros
- Hobbit server and client need to be cross-platform thus the need of CPAM/TWW.
- Like Emacs editor, it can will be run everywhere without license. TWW tools is GPL opensource so it can be ported to any OS.
- A structural and automated approach to deal with packages creation and management.
- Cons
- Another learning curve need to climb.
- Changing people's development habit is hard.
Supported OS
[edit | edit source]- Solaris Sparc
- RH AS 3.0
- HP-UX 11.11
Hobbit package sources
[edit | edit source]Hobbit client on MS windows Overview
[edit | edit source]- bbwin (Xymon client) is implemented in c++. It requires opensource software like boost c++ libary and tinyXML.
- The packaging tool it used is Microsoft's opensource packaging tool - WiXto do the Win32 packaging.
- The detals building instruction is build.txt on bbwin project site.
- You have two ways to build BBWin.msi,
- Use Microsoft's make: nmake
- Use "Build Soultion" in VS2008.
Following is a procedure to create a Windows XP development box so you can create your own BBWin.msi.
Prepare your Xymon win32 build environment
[edit | edit source]- Install hhc.exe,it is used to compile html doc into windows chm help file.
- add "C:\Program Files\HTML Help Workshop" into PATH so hhc.exe is accessible.
- Install Visual Studio 2008 Standard or Professional Edition.
- Make sure your cmd.exe has following PATH name addition. echo %PATH% %INCLUDE% %LIB% in your DOS prompt.
- PATH
- "LIB=C:\Program Files\Microsoft Platform SDK\Lib\.;C:\Program Files\Microsoft Visual Studio 8\VC\LIB;"
- INCLUDE
INCLUDE=C:\Program Files\Microsoft Platform SDK\Include\.; C:\Program Files\Microsoft Platform SDK\Include\atl;C:\Program Files\Microsoft Visual Studio 8\VC\include
- Install a svn client for your windows machine.
- Windows Server 2003 SP1 Platform SDK Web Install: It is use to have the complete sdk to develop programs on Microsoft OS. Remeber to install all options (include 64 bit and 32 bit) to avoid "atlthunk.lib not found" issue.
- WiX opensource packaging tool from Microsoft: this is use to turn the compiled binary into MS MSI package format.
- Boost C++ library:These powerful C++ libraries are used for some agents and will be certainly used in the BBWin core service in the future.
- Download the pre-compiled 1.35 one for VS2008 and install it under C:\boost directory.
- TinyXML: BBWin used the excellent TinyXML library for the configuration loading XML. You do not need to download and install it. TinyXML sources are included in BBWin sources.
- Prepare your source code editors:
- checkout bbwin src.
- Using command "svn co https://bbwin.svn.sourceforge.net/svnroot/bbwin bbwin"
- Change the Makefile code for C:\boost installation.
- Modify Makefile to point INCLUDE to C:\boost and LIB to include C:\boost\lib\*.lib
- Modify C/C++ iclude c:\boost and Linker to include c:\boost\lib\*.
- Optional software installation
- install cygwin to have a strong unix enviroment on your windows box. So you can run command like following to clean up *.obj file that current makefile can't do.
- Clean up Release directory by Deleting Setup/*.msi
$ rm Setup/* $ rm Release/*
Build the bbwin using command line approach
[edit | edit source]BBWin.msi creation process is automated in "C:\BBWin\trunk\Setup\Makefile". This makefile will be called from "C:\BBWin\trunk\Makefile"
- Make sure your nmake command is available.
C:\bbwin-src\trunk>nmake -help
Microsoft (R) Program Maintenance Utility Version 8.00.50727.762
Copyright (C) Microsoft Corporation. All rights reserved.
Usage: NMAKE @commandfile
NMAKE [options] [/f makefile] [/x stderrfile] [macrodefs] [targets]
Options:
/A Build all evaluated targets
/B Build if time stamps are equal
/C Suppress output messages
/D Display build information
/E Override env-var macros
/ERRORREPORT:{NONE|PROMPT|QUEUE|SEND} Report errors to Microsoft
/G Display !include filenames
/HELP Display brief usage message
/I Ignore exit codes from commands
/K Build unrelated targets on error
/N Display commands but do not execute
/NOLOGO Suppress copyright message
/P Display NMAKE information
/Q Check time stamps but do not build
/R Ignore predefined rules/macros
/S Suppress executed-commands display
/T Change time stamps but do not build
/U Dump inline files
/Y Disable batch-mode
/? Display brief usage message
C:\bbwin-src\trunk>
- cd to c:\bbwin top source directory.
- type "nmake" to kick off the build.
Compilation error
[edit | edit source]atlbase.h not found
[edit | edit source]- Error message
C:\bbwin\trunk\Core\Agents\common>nmake
Microsoft (R) Program Maintenance Utility Version 9.00.30729.01
Copyright (C) Microsoft Corporation. All rights reserved.
cl -Zi -Od -DDEBUG -c -DCRTAPI1=_cdecl -DCRTAPI2=_cdecl -nologo -GS -D_X
86_=1 -DWIN32 -D_WIN32 -W3 -D_WINNT -D_WIN32_WINNT=0x0500 -DNTDDI_VERSION=0x050
00000 -D_WIN32_IE=0x0500 -DWINVER=0x0500 /EHsc /I ../.. /I C:\boost\include\boos
t-1_33_1 -D_MT -MTd SystemCounters.cpp
SystemCounters.cpp
SystemCounters.cpp(20) : fatal error C1083: Cannot open include file: 'atlbase.h
': No such file or directory
NMAKE : fatal error U1077: '"C:\Program Files\Microsoft Visual Studio 9.0\VC\BIN
\cl.EXE"' : return code '0x2'
Stop.
C:\bbwin\trunk\Core\Agents\common>
- make sure you have following directory and file, if not then you need to use VS non-Express version.
C:\Program Files\Microsoft Visual Studio 8\VC\atlmfc\include\atlbase.h
Temporary Fix for following
[edit | edit source]- Goal is to get rid of " -D_MT -MTd" when using cl MS compiler.
- Run this command in cygwin shell on your codebase, "find . -type f -name Makefile -exec perl -pi -e 's!cvarsmt!conlibsdll!' {} \;" , to replace cvarsmt with conlibsdll. I don't know the exact impact of not building code with multihreading library.
* LINK : warning LNK4098: defaultlib 'LIBCMT' conflicts with use of other libs; use /NODEFAULTLIB:library
[edit | edit source]*** C:\bbwin09\trunk\Core\Agents\procs *** "C:\Program Files\Microsoft Visual Studio 8\VC\BIN\nmake.exe" -nologo /L link /DLL procs.obj procs.res -out:procs.dll /LIBPATH:C:\boost\lib libboost_date_time-vc80-mt-s.lib Microsoft (R) Incremental Linker Version 8.00.50727.762 Copyright (C) Microsoft Corporation. All rights reserved. LIBCMT.lib(invarg.obj) : error LNK2005: __initp_misc_invarg already defined in LIBCMTD.lib(invarg.obj) LIBCMT.lib(invarg.obj) : error LNK2005: __invoke_watson already defined in LIBCMTD.lib(invarg.obj) LIBCMT.lib(invarg.obj) : error LNK2005: __set_invalid_parameter_handler already defined in LIBCMTD.lib(invarg.obj) LIBCMT.lib(invarg.obj) : error LNK2005: __get_invalid_parameter_handler already defined in LIBCMTD.lib(invarg.obj) LIBCMT.lib(invarg.obj) : error LNK2005: "void __cdecl _invoke_watson(unsigned short const *,unsigned short const *,unsigned short const *,unsigned int,unsigned int)" (?_invoke_watson@@YAXPBG00II@Z) already defined in LIBCMTD.lib(invarg.obj) LIBCMT.lib(invarg.obj) : error LNK2005: __invalid_parameter already defined in LIBCMTD.lib(invarg.obj) LIBCMT.lib(invarg.obj) : error LNK2005: "void __cdecl _invalid_parameter(unsigned short const *,unsigned short const *,unsigned short const *,unsigned int,unsigned int)" (?_invalid_parameter@@YAXPBG00II@Z) already defined in LIBCMTD.lib(invarg.obj) LIBCMT.lib(invarg.obj) : error LNK2005: ___pInvalidArgHandler already defined in LIBCMTD.lib(invarg.obj) Creating library procs.lib and object procs.exp LINK : warning LNK4098: defaultlib 'LIBCMT' conflicts with use of other libs; use /NODEFAULTLIB:library procs.dll : fatal error LNK1169: one or more multiply defined symbols found NMAKE : fatal error U1077: '"C:\Program Files\Microsoft Visual Studio 8\VC\BIN\link.EXE"' : return code '0x491' Stop. *** C:\bbwin09\trunk\Core\Agents\sample *** "C:\Program Files\Microsoft Visual Studio 8\VC\BIN\nmake.exe" -nologo /L *** C:\bbwin09\trunk\Core\Agents\bbwinupdate *** "C:\Program Files\Microsoft Visual Studio 8\VC\BIN\nmake.exe" -nologo /L C:\bbwin09\trunk\Core>
- http://msdn.microsoft.com/en-us/library/Aa267384
- Possible fix with similar issue.
- vc6 to vc8.
- Try to link with "/NODEFAULTLIB:library".
C:\bbwin09\trunk\Core\Agents\procs>nmake clean
nmake clean
Microsoft (R) Program Maintenance Utility Version 8.00.50727.762
Copyright (C) Microsoft Corporation. All rights reserved.
erase /Q /S procs.res procs.obj procs.dll procs.exp procs.lib procs.obj
Deleted file - C:\bbwin09\trunk\Core\Agents\procs\procs.res
Deleted file - C:\bbwin09\trunk\Core\Agents\procs\procs.obj
Deleted file - C:\bbwin09\trunk\Core\Agents\procs\procs.exp
Deleted file - C:\bbwin09\trunk\Core\Agents\procs\procs.lib
C:\bbwin09\trunk\Core\Agents\procs>nmake
nmake
Microsoft (R) Program Maintenance Utility Version 8.00.50727.762
Copyright (C) Microsoft Corporation. All rights reserved.
cl -Zi -Od -DDEBUG -c -DCRTAPI1=_cdecl -DCRTAPI2=_cdecl -nologo -GS -D_X86_=1 -DWIN32 -D_WIN32 -W3 -D_WINNT -D_WIN32_WINNT=0x0500 -D_WIN32_IE=0x0500 -DWINVER=0x0500 /EHsc /I ../.. /I ../common /I C:\boost\include\boost-1_33_1 -D_MT -MTd procs.cpp
procs.cpp
C:\boost\include\boost-1_33_1\boost/date_time/c_time.hpp(68) : warning C4996: 'localtime': This function or variable may be unsafe. Consider using localtime_s instead. To disable deprecation, use _CRT_SECURE_NO_WARNINGS. See online help for details.
C:\Program Files\Microsoft Visual Studio 8\VC\include\time.inl(114) : see declaration of 'localtime'
C:\boost\include\boost-1_33_1\boost/date_time/c_time.hpp(75) : warning C4996: 'gmtime': This function or variable may be unsafe. Consider using gmtime_s instead. To disable deprecation, use _CRT_SECURE_NO_WARNINGS. See online help for details.
C:\Program Files\Microsoft Visual Studio 8\VC\include\time.inl(101) : see declaration of 'gmtime'
C:\boost\include\boost-1_33_1\boost/utility/enable_if.hpp : warning C4819: The file contains a character that cannot be represented in the current code page (950). Save the file in Unicode format to prevent data loss
C:\boost\include\boost-1_33_1\boost/lexical_cast.hpp : warning C4819: The file contains a character that cannot be represented in the current code page (950). Save the file in Unicode format to prevent data loss
C:\boost\include\boost-1_33_1\boost/utility/enable_if.hpp : warning C4819: The file contains a character that cannot be represented in the current code page (950). Save the file in Unicode format to prevent data loss
C:\boost\include\boost-1_33_1\boost/type_traits/is_base_and_derived.hpp : warning C4819: The file contains a character that cannot be represented in the current code page (950). Save the file in Unicode format to prevent data loss
C:\boost\include\boost-1_33_1\boost/lexical_cast.hpp : warning C4819: The file contains a character that cannot be represented in the current code page (950). Save the file in Unicode format to prevent data loss
C:\boost\include\boost-1_33_1\boost/tokenizer.hpp : warning C4819: The file contains a character that cannot be represented in the current code page (950). Save the file in Unicode format to prevent data loss
C:\boost\include\boost-1_33_1\boost/lexical_cast.hpp : warning C4819: The file contains a character that cannot be represented in the current code page (950). Save the file in Unicode format to prevent data loss
C:\boost\include\boost-1_33_1\boost/lexical_cast.hpp : warning C4819: The file contains a character that cannot be represented in the current code page (950). Save the file in Unicode format to prevent data loss
C:\boost\include\boost-1_33_1\boost/tokenizer.hpp : warning C4819: The file contains a character that cannot be represented in the current code page (950). Save the file in Unicode format to prevent data loss
C:\boost\include\boost-1_33_1\boost/lexical_cast.hpp : warning C4819: The file contains a character that cannot be represented in the current code page (950). Save the file in Unicode format to prevent data loss
C:\boost\include\boost-1_33_1\boost/format/internals.hpp : warning C4819: The file contains a character that cannot be represented in the current code page (950). Save the file in Unicode format to prevent data loss
C:\boost\include\boost-1_33_1\boost/format/alt_sstream_impl.hpp : warning C4819: The file contains a character that cannot be represented in the current code page (950). Save the file in Unicode format to prevent data loss
C:\boost\include\boost-1_33_1\boost/format/internals.hpp : warning C4819: The file contains a character that cannot be represented in the current code page (950). Save the file in Unicode format to prevent data loss
C:\boost\include\boost-1_33_1\boost/format/alt_sstream_impl.hpp(252) : warning C4996: 'std::char_traits<char>::copy': Function call with parameters that may be unsafe - this call relies on the caller to check that the passed values are correct. To disable this warning, use -D_SCL_SECURE_NO_WARNINGS. See documentation on how to use Visual C++ 'Checked Iterators'
C:\Program Files\Microsoft Visual Studio 8\VC\include\iosfwd(446) : see declaration of 'std::char_traits<char>::copy'
C:\boost\include\boost-1_33_1\boost/format/alt_sstream_impl.hpp(223) : while compiling class template member function 'int boost::io::basic_altstringbuf<Ch,Tr,Alloc>::overflow(int)'
with
[
Ch=char,
Tr=std::char_traits<char>,
Alloc=std::allocator<char>
]
C:\boost\include\boost-1_33_1\boost/format/format_class.hpp(136) : see reference to class template instantiation 'boost::io::basic_altstringbuf<Ch,Tr,Alloc>' being compiled
with
[
Ch=char,
Tr=std::char_traits<char>,
Alloc=std::allocator<char>
]
procs.cpp(235) : see reference to class template instantiation 'boost::basic_format<Ch>' being compiled
with
[
Ch=char
]
Rc /r -DWIN32 -D_WIN32 -DWINVER=0x0500 -DDEBUG -D_DEBUG /fo procs.res procs.rc
link /NODEFAULTLIB:library procs.obj procs.res -out:procs.dll /LIBPATH:C:\boost\lib libboost_date_time-vc80-mt-s.lib
Microsoft (R) Incremental Linker Version 8.00.50727.762
Copyright (C) Microsoft Corporation. All rights reserved.
LIBCMT.lib(invarg.obj) : error LNK2005: __initp_misc_invarg already defined in LIBCMTD.lib(invarg.obj)
LIBCMT.lib(invarg.obj) : error LNK2005: __invoke_watson already defined in LIBCMTD.lib(invarg.obj)
LIBCMT.lib(invarg.obj) : error LNK2005: __set_invalid_parameter_handler already defined in LIBCMTD.lib(invarg.obj)
LIBCMT.lib(invarg.obj) : error LNK2005: __get_invalid_parameter_handler already defined in LIBCMTD.lib(invarg.obj)
LIBCMT.lib(invarg.obj) : error LNK2005: "void __cdecl _invoke_watson(unsigned short const *,unsigned short const *,unsigned short const *,unsigned int,unsigned int)" (?_invoke_watson@@YAXPBG00II@Z) already defined in LIBCMTD.lib(invarg.obj)
LIBCMT.lib(invarg.obj) : error LNK2005: __invalid_parameter already defined in LIBCMTD.lib(invarg.obj)
LIBCMT.lib(invarg.obj) : error LNK2005: "void __cdecl _invalid_parameter(unsigned short const *,unsigned short const *,unsigned short const *,unsigned int,unsigned int)" (?_invalid_parameter@@YAXPBG00II@Z) already defined in LIBCMTD.lib(invarg.obj)
LIBCMT.lib(invarg.obj) : error LNK2005: ___pInvalidArgHandler already defined in LIBCMTD.lib(invarg.obj)
Creating library procs.lib and object procs.exp
LINK : warning LNK4098: defaultlib 'LIBCMT' conflicts with use of other libs; use /NODEFAULTLIB:library
LIBCMTD.lib(crt0.obj) : error LNK2019: unresolved external symbol _main referenced in function ___tmainCRTStartup
procs.dll : fatal error LNK1120: 1 unresolved externals
NMAKE : fatal error U1077: '"C:\Program Files\Microsoft Visual Studio 8\VC\BIN\link.EXE"' : return code '0x460'
Stop.
C:\bbwin09\trunk\Core\Agents\procs>
build the bbwin using GUI approach
[edit | edit source]- check out the source code
- open up bbwin.sln
follow text will turn into wiki procedure above.
Build file for BBWin
2 ==============================================================
3
4 This file explains you how to build BBWin from the sources.
5
6
7 Getting the last sources
8 ========================
9
10 BBWin is developped in C++ (the Standard Template Library and the Standard C++ Library
11 are used)
12 The source of BBWin are available from the sourceforge subversion
13 repository for the BBWin projects :
14 http://svn.sourceforge.net/viewcvs.cgi/bbwin/
15
16
17 Install the tools
18 =================
19
20 BBWin has been developped thanks to many tools. You should install them to
21 build BBWin easily without troubles.
22
23 Windows Platform SDK 2003 : it is used for the development environment.
24 It is use to have the complete sdk to develop programs on Microsoft OS.
25 You can download it for free from microsoft website :
26 http://www.microsoft.com/downloads/details.aspx?FamilyId=A55B6B43-E24F-4EA3-A93E-40C0EC4F68E5&displaylang=en
27 You will need 1 gb of free space if you install every thing :)
28 BBWin Makefiles are using the nmake tool and Makefile templates from the SDK.
29 This SDK is very important for anyone who would like to start developing under Windows.
30
31 Visual C++ Toolkit : it is the compiler used to build the bbwin release
32 It is the original compiler from Visual Studio 2003 Professional (Code optimisation is included)
33 You can download it for free from the Microsoft website :
34 http://msdn.microsoft.com/visualc/vctoolkit2003/
35
36 Wix Toolkit : this package is used to build the BBWin MSI installer
37 You should install it and have the bin directory in your current path
38 http://sourceforge.net/projects/wix/
39
40 TinyXML : BBWin used the excellent TinyXML library for the configuration loading XML.
41 You do not need to install it. TinyXML sources are included in BBWin sources.
42
43 Boost Lib : These powerful C++ libraries are used for some agents and will be
44 certainly used in the BBWin core service in the future.
45 You should get the boost C++ from the website :
46 http://www.boost.org/
47 Build it in the directory C:\boost so you won't have to change BBWin Makefiles.
48 If you want to build BBWin with Visual C++ Express 2005, please read the following page :
49 http://www.boost.org/tools/build/v1/vc-8_0-tools.html
50
51
52 I recommand you the Notepad++ editor if you are looking for a nice free code editor.
53 You can download it from :
54 http://notepad-plus.sourceforge.net
55
56
57
58 Building the BBWin with Visual C++ Express 2005
59 ===============================================
60
61 Open the BBWin.sln file at the top directory of the project
62 First, you should prepare your Visual C++ configuration by adding
63 in the default bin, include and lib directories the different directories from :
64
65 - the platform SDK
66 - the boost libraries
67
68 Then just build the solution.
69
70
71 Building the BBWin with Visual C++ ToolKit 2003
72 ===============================================
73
74 Open a Platform SDK Build command line environment (installed with the Platform SDK)
75 Go the top directory of the BBWin source tree
76 Type nmake
77 Go get a cup of coffee
78 It's ready !
79
80 If you get errors, it may be due to some errors in your include or lib path.
81 Make sure the environment variables %Lib%; %Path% and %Include% are correctly
82 configured. You may need to add some directories.
83
84 Building process order
85 ======================
86
87 1) BBWin core service
88 2) Agents
89 3) Externals (needing compilation)
90 4) Setup MSI
91
- Example of using nmake to create a BBwin.msi
C:\tmp\test\trunk\Setup>nmake clean
Microsoft (R) Program Maintenance Utility Version 8.00.50727.42
Copyright (C) Microsoft Corporation. All rights reserved.
erase /q /s BBWin.dll BBWin.exp UpgradeConfiguration.obj BBWin.res BBWin
.wixobj BBWin.msi BBWin.lib
Deleted file - C:\tmp\test\trunk\Setup\BBWin.wixobj
Deleted file - C:\tmp\test\trunk\Setup\BBWin.msi
C:\tmp\test\trunk\Setup>nmake
Microsoft (R) Program Maintenance Utility Version 8.00.50727.42
Copyright (C) Microsoft Corporation. All rights reserved.
candle /nologo BBWin.wxs
BBWin.wxs
light /nologo BBWin.wixobj
C:\tmp\test\trunk\Setup>
bbwin 0.9 package source
[edit | edit source]Hobbit server software build source
[edit | edit source]How to use hobbit-4.0.3.sb build source ?
[edit | edit source]- hobbit-4.0.3.sb is an XML file contain the detail exact steps to build hobbit-4.03. into binary code for different OS. It need to be run against "sb" tool.
- TBA.
The source : hobbit-4.0.3.sb
[edit | edit source][root] cat hobbit-4.0.3.sb
<?xml version="1.0"?>
<programs>
<program name="hobbit" version="4.0.3" revision="1">
<module name="default">
<build-name>hobbit-4.0.3</build-name>
<install-name>hobbit</install-name>
<syntaxhighlights>
<syntaxhighlight path="src/hobbit-4.0.3.tar.gz" />
</sources>
<dependencies>
<depend var="fping">fping24</depend>
<depend var="APACHESS">apacheS2048</depend>
<depend var="RRDTOOL">rrdtool10</depend>
<depend var="PCRE">libpcre44</depend>
<depend var="OPENSSL">libopenssl097</depend>
<depend var="OPENLDAP">openldap2127</depend>
</dependencies>
<!--
######################################
# Platform specific configuration
######################################
-->
<configure>
<![CDATA[
case "${SB_SYSTYPE}" in
*-hpux11.11)
;;
*-hpux10.20)
;;
*-linux*)
;;
*-solaris2*)
;;
esac
set -x
rm -f Makefile
TARGET=hobbit \
ENABLESSL=y \
ENABLELDAP=y \
ENABLELDAPSSL=y \
BBUSER=hobbit \
BBTOPDIR=/opt/TWWfsw/hobbit \
BBVAR=/var/opt/TWWfsw/hobbit/data \
BBHOSTURL=/hobbit \
CGIDIR=/etc/opt/TWWfsw/apacheS2048/cgi-bin \
BBCGIURL=/hobbit-cgi \
SECURECGIDIR=/etc/opt/TWWfsw/apacheS2048/cgi-secure \
SECUREBBCGIURL=/hobbit-seccgi \
HTTPDGID=il02w-web \
BBLOGDIR=/var/opt/TWWfsw/hobbit/log/hobbit \
BBHOSTNAME=localhost \
BBHOSTIP=127.0.0.1 \
MANROOT=/opt/TWWfsw/hobbit/man \
BARS=all \
USENEWHIST=y \
PIXELCOUNT=960 \
MAKE=/opt/TWWfsw/bin/gmake \
INSTALLBINDIR=/opt/TWWfsw/hobbit/server/bin \
INSTALLETCDIR=/opt/TWWfsw/hobbit/server/etc \
INSTALLWEBDIR=/opt/TWWfsw/hobbit/web \
INSTALLEXTDIR=/opt/TWWfsw/hobbit/server \
INSTALLTMPDIR=/var/opt/TWWfsw/hobbit/tmp \
INSTALLWWWDIR=/opt/TWWfsw/hobbit/server/www ./configure \
--rrdinclude /opt/TWWfsw/rrdtool10/include \
--rrdlib /opt/TWWfsw/rrdtool10/lib \
--pcreinclude /opt/TWWfsw/libpcre44/include \
--pcrelib /opt/TWWfsw/libpcre44/lib \
--sslinclude /opt/TWWfsw/libopenssl097/include \
--ssllib /opt/TWWfsw/libopenssl097/lib \
--ldapinclude /opt/TWWfsw/openldap2127/include \
--ldaplib /opt/TWWfsw/openldap2127/lib \
--fping /opt/TWWfsw/fping24/sbin/fping
]]>
</configure>
<!--
######################################
# Now build (compile) the software
######################################
-->
<build>
<![CDATA[
case "${SB_SYSTYPE}" in
*-hpux11.11)
gmake
;;
*-hpux10.20)
;;
*-linux*)
gmake
;;
*-solaris2.[689])
gmake
;;
esac
]]>
</build>
<install>
<![CDATA[
########################################################
# building hobbit on different OS
########################################################
case "${SB_SYSTYPE}" in
*-hpux11.11)
gmake install
;;
*-hpux10.20)
;;
*-linux*)
gmake install
;;
*-solaris2.[689])
LD_LIBRARY_PATH=/opt/TWWfsw/libopenssl097/lib
export LD_LIBRARY_PATH
gmake install
;;
esac
## create man directory for TWW
#ln -s /opt/TWWfsw/hobbit/server/bin /opt/TWWfsw/hobbit/bin
#mkdir -p /opt/TWWfsw/hobbit/man
#cp -rp /opt/TWWfsw/hobbit/server/www/help/manpages/* /opt/TWWfsw/hobbit/man
#
]]>
</install>
<uninstall>
<![CDATA[
set -x
rm -rf /opt/TWWfsw/hobbit
rm -rf /etc/opt/TWWfsw/apacheS2048/cgi-secure
rm -rf /etc/opt/TWWfsw/apacheS2048/cgi-bin/bb-*
rm -rf /etc/opt/TWWfsw/apacheS2048/cgi-bin/hobbit*
rm -rf /var/opt/TWWfsw/hobbit
]]>
</uninstall>
</module>
<notes>
<note type="installation">
<para>
This sb file is to digitalize the hobbit software build process for different OS.
Original: 05/26/2005 T.J.Yang tj_yang at hotmail do com
</para>
</note>
</notes>
<changelog>
</changelog>
</program>
</programs>
[root]
Hobbit server package build source
[edit | edit source]hobbit-4.0.3.pb
[edit | edit source][root] cat hobbit-4.0.3.pb
<?xml version="1.0"?>
<packages>
<package name="hobbit" version="4.0.3" revision="1">
<package-manager name="depot">
<title>hobbit</title>
<vendor>GPL</vendor>
<description >
</description>
<install-name>hobbit</install-name>
<pkgname-base>TWWhobbit</pkgname-base>
<version>4.0.3</version>
<revision>1</revision>
<subpkg type="runtime">
</subpkg>
</package-manager>
<package-manager name="rpm4">
<category>System Environment/Daemons</category>
<title>Hobbit System Monitoring Tool</title>
<vendor>GNU</vendor>
<description>
Hobbit System Monitoring tool. An open-source version of Big Brother.
</description>
<install-name>hobbit</install-name>
<pkgname-base>TWWhobbit</pkgname-base>
<init name="/etc/init.d/TWWhobbit" path="pkg/hobbit-init-linux" />
<init link-src="/etc/rc2.d/S661hobbit"
link-dest="/etc/init.d/TWWhobbit"/>
<init link-src="/etc/rc1.d/K269hobbit"
link-dest="/etc/init.d/TWWhobbit"/>
<config>/etc/init.d/TWWhobbit</config>
<version>4.0.3</version>
<revision>1</revision>
<subpkg type="runtime">
<depend pkgname-base="TWWperl561" title="perl 5.6.1" subpkg="runtime">v>=5.6.1 r>=1</depend>
<depend pkgname-base="TWWrrdtool10" title="Round Robin Database" subpkg="runtime">v>=1.0.42</depend>
<depend pkgname-base="TWWrrdtool10" title="Round Robin Database" subpkg="man">v>=1.0.42</depend>
</subpkg>
<subpkg type="conf">
<depend pkgname-base="TWWhobbit" title="Client: Big Brother System Monitoring Tool" subpkg="runtime">v>=4.0.3</depend>
<postinstall path="pkg/postinstall-linux" />
<preremove path="pkg/preremove-linux" />
<postremove path="pkg/postremove-linux" />
</subpkg>
</package-manager>
</package>
</packages>
[root]
Hobbit Required Packages
[edit | edit source]- fping
- apache web server
- rrdtool
- pcre
- openssl
- openldap
- following is the listing of exact version to build hobbit-4.0.3
<dependencies>
<depend var="fping">fping24</depend>
<depend var="APACHESS">apacheS2048</depend>
<depend var="RRDTOOL">rrdtool10</depend>
<depend var="PCRE">libpcre44</depend>
<depend var="OPENSSL">libopenssl097</depend>
<depend var="OPENLDAP">openldap2127</depend>
</dependencies>
Following diagram list out all the hobbit depended software by GraphViz
[edit | edit source]TBA.
Package build automation
[edit | edit source]The Makefile to automate the whole process
[edit | edit source]Create a firefox search engine plugin for hobbit server
[edit | edit source]- References: http://mycroft.mozdev.org/deepdocs/deepdocs.html
Using relational DBs with Xymon Server
[edit | edit source]The default database back end of Xymon is RRD(Roun-Robin Database).
Database
[edit | edit source]RRD
[edit | edit source]SQLite3
[edit | edit source]- Almost as fast as C fopen function code.
- No server process, data are store in plain files.
- Just like another rrd file that can be rsynced over to your standby xymon server.
MySql
[edit | edit source]- light weight DB.
Oracle
[edit | edit source]LDAP
[edit | edit source]XML flat file
[edit | edit source]Benefits of using relation DBs
[edit | edit source]Inventory Monitoring
[edit | edit source]- Store a machine's asset information
- Serial Number
- OS type
- Computer Maker
- Leased/owned
- Trigger an alert if leasing is expiring soon.
- Display pie chart of OS type,Makers ... etc.
bb-hosts generation
[edit | edit source]- bb-hosts files got generated from host database table.
MVC Implementation
[edit | edit source]Mysql + PHP + EXTJS
[edit | edit source]Catalyst/SQLite
[edit | edit source]Bill of Materials
[edit | edit source]- Catalyst Book 1
- perl-5.10.0
- Fedora 11
- Address Book Example in Book 1.
- SQLite3
- Catalyst::Runtime,Catalyst::Plugins::*,Catalyst::Devel.
- Sql files to create Asset schema.
Procedures
[edit | edit source]- Use catalyst.pl to initiate your MVC project with sample templates.
[tjyang@t-fedora11 test]$ catalyst.pl xymonasset created "xymonasset" created "xymonasset/script" created "xymonasset/lib" created "xymonasset/root" created "xymonasset/root/static" created "xymonasset/root/static/images" created "xymonasset/t" created "xymonasset/lib/xymonasset" created "xymonasset/lib/xymonasset/Model" created "xymonasset/lib/xymonasset/View" created "xymonasset/lib/xymonasset/Controller" created "xymonasset/xymonasset.conf" created "xymonasset/lib/xymonasset.pm" created "xymonasset/lib/xymonasset/Controller/Root.pm" created "xymonasset/README" created "xymonasset/Changes" created "xymonasset/t/01app.t" created "xymonasset/t/02pod.t" created "xymonasset/t/03podcoverage.t" created "xymonasset/root/static/images/catalyst_logo.png" created "xymonasset/root/static/images/btn_120x50_built.png" created "xymonasset/root/static/images/btn_120x50_built_shadow.png" created "xymonasset/root/static/images/btn_120x50_powered.png" created "xymonasset/root/static/images/btn_120x50_powered_shadow.png" created "xymonasset/root/static/images/btn_88x31_built.png" created "xymonasset/root/static/images/btn_88x31_built_shadow.png" created "xymonasset/root/static/images/btn_88x31_powered.png" created "xymonasset/root/static/images/btn_88x31_powered_shadow.png" created "xymonasset/root/favicon.ico" created "xymonasset/Makefile.PL" created "xymonasset/script/xymonasset_cgi.pl" created "xymonasset/script/xymonasset_fastcgi.pl" created "xymonasset/script/xymonasset_server.pl" created "xymonasset/script/xymonasset_test.pl" created "xymonasset/script/xymonasset_create.pl" [tjyang@t-fedora11 test]$ catalyst.pl
- perl Makefile.PL
[tjyang@t-fedora11 xymonasset]$ perl Makefile.PL include /var/www/html/test/xymonasset/inc/Module/Install.pm include inc/Module/Install/Metadata.pm include inc/Module/Install/Base.pm Cannot determine perl version info from lib/xymonasset.pm include inc/Module/Install/Catalyst.pm *** Module::Install::Catalyst include inc/Module/Install/Makefile.pm Please run "make catalyst_par" to create the PAR package! *** Module::Install::Catalyst finished. include inc/Module/Install/Scripts.pm include inc/Module/Install/AutoInstall.pm include inc/Module/Install/Include.pm include inc/Module/AutoInstall.pm *** Module::AutoInstall version 1.03 *** Checking for Perl dependencies... [Core Features] - Catalyst::Runtime ...loaded. (5.71001 >= 5.71001) - Catalyst::Plugin::ConfigLoader ...loaded. (0.22) - Catalyst::Plugin::Static::Simple ...loaded. (0.20) - Catalyst::Action::RenderView ...loaded. (0.09) - parent ...loaded. (0.221) - Config::General ...loaded. (2.42) *** Module::AutoInstall configuration finished. include inc/Module/Install/WriteAll.pm include inc/Module/Install/Win32.pm include inc/Module/Install/Can.pm include inc/Module/Install/Fetch.pm Writing Makefile for xymonasset Writing META.yml [tjyang@t-fedora11 xymonasset]$
Upgrade Xymon Web GUI
[edit | edit source]Current Xymon(Hobbit) is coded in C and using CGI and html code to compose a simple web interface. Recently, we have a few javascript framework choices to upgrade xymon server with RIA web interface.
Using qwikioffice for Xymon Dashboard
[edit | edit source]Using Tomatocart's admin tool for Xymon administration tool
[edit | edit source]Replace Xymon C/CGI with C/EXTJS
[edit | edit source]Compilation Errors and Warning
[edit | edit source]Possible Solutions
[edit | edit source]- To remove "unsigned char" usage hobbit src tree.
find . -type f -name "*.[c|h]" -exec perl -pi -e 's!unsigned\schar!char!g' {} \;
- To cast the char that need to be unsigned.
GCC Compilation Warnings
[edit | edit source]- pointer targets in assignment differ in signedness
- "/usr/include/sys/socket.h:214: note: expected socklen_t * __restrict__ but argument is of type int *"
Compilation Warning on 4.3.0 C source code example listing
[edit | edit source][tjyang@f12 4.3.0]$ gmake MAKE="gmake" CC="gcc" CFLAGS="-g -O2 -Wall -Wno-unused -D_REENTRANT -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -DLINUX -I. -I`pwd`/include -DCLIENTONLY=1" LDFLAGS="" `pwd`/build/genconfig.sh Checking for socklen_t Checking for snprintf Checking for vsnprintf Checking for rpc/rpcent.h Checking for sys/select.h Checking for u_int32_t typedef Checking for PATH_MAX definition Checking for SHUT_RD/WR/RDWR definitions Checking for strtoll() config.h created <snip> gcc -g -O2 -Wall -Wno-unused -D_REENTRANT -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -DLINUX -I. -I/home/tjyang/hobbitmon/branches/4.3.0/include -DCLIENTONLY=1 -I. -I../include -c -o digest.o digest.c digest.c: In function âmd5hashâ: digest.c:40: warning: pointer targets in passing argument 2 of âmyMD5_Updateâ differ in signedness /home/tjyang/hobbitmon/branches/4.3.0/include/../lib/md5.h:18: note: expected âunsigned char *â but argument is of type âchar *â gcc -g -O2 -Wall -Wno-unused -D_REENTRANT -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -DLINUX -I. -I/home/tjyang/hobbitmon/branches/4.3.0/include -DCLIENTONLY=1 -I. -I../include -c -o encoding.o encoding.c encoding.c: In function âbase64encodeâ: encoding.c:31: warning: pointer targets in passing argument 1 of âstrlenâ differ in signedness /usr/include/string.h:397: note: expected âconst char *â but argument is of type âunsigned char *â encoding.c:34: warning: pointer targets in passing argument 1 of âstrlenâ differ in signedness /usr/include/string.h:397: note: expected âconst char *â but argument is of type âunsigned char *â encoding.c:50: warning: pointer targets in passing argument 1 of âstrlenâ differ in signedness /usr/include/string.h:397: note: expected âconst char *â but argument is of type âunsigned char *â encoding.c:60: warning: pointer targets in passing argument 1 of âstrlenâ differ in signedness /usr/include/string.h:397: note: expected âconst char *â but argument is of type âunsigned char *â encoding.c:75: warning: pointer targets in return differ in signedness encoding.c: In function âbase64decodeâ: encoding.c:86: warning: pointer targets in passing argument 1 of âstrlenâ differ in signedness /usr/include/string.h:397: note: expected âconst char *â but argument is of type âunsigned char *â encoding.c:114: warning: pointer targets in return differ in signedness encoding.c: In function âgetescapestringâ: encoding.c:125: warning: pointer targets in assignment differ in signedness encoding.c: In function ânlencodeâ: encoding.c:181: warning: pointer targets in assignment differ in signedness encoding.c:183: warning: pointer targets in passing argument 1 of âstrlenâ differ in signedness /usr/include/string.h:397: note: expected âconst char *â but argument is of type âunsigned char *â encoding.c:187: warning: pointer targets in assignment differ in signedness encoding.c:191: warning: pointer targets in assignment differ in signedness encoding.c:198: warning: pointer targets in passing argument 1 of â__builtin_strcspnâ differ in signedness encoding.c:198: note: expected âconst char *â but argument is of type âunsigned char *â encoding.c:198: warning: pointer targets in passing argument 1 of âstrlenâ differ in signedness /usr/include/string.h:397: note: expected âconst char *â but argument is of type âunsigned char *â encoding.c:198: warning: pointer targets in passing argument 1 of â__strcspn_c1â differ in signedness /usr/include/bits/string2.h:971: note: expected âconst char *â but argument is of type âunsigned char *â encoding.c:198: warning: pointer targets in passing argument 1 of â__strcspn_c2â differ in signedness /usr/include/bits/string2.h:982: note: expected âconst char *â but argument is of type âunsigned char *â encoding.c:198: warning: pointer targets in passing argument 1 of â__strcspn_c3â differ in signedness /usr/include/bits/string2.h:994: note: expected âconst char *â but argument is of type âunsigned char *â encoding.c:198: warning: pointer targets in passing argument 1 of â__builtin_strcspnâ differ in signedness encoding.c:198: note: expected âconst char *â but argument is of type âunsigned char *â encoding.c:198: warning: pointer targets in passing argument 1 of â__builtin_strcspnâ differ in signedness encoding.c:198: note: expected âconst char *â but argument is of type âunsigned char *â encoding.c: In function ânldecodeâ: encoding.c:231: warning: pointer targets in passing argument 1 of â__builtin_strcspnâ differ in signedness encoding.c:231: note: expected âconst char *â but argument is of type âunsigned char *â encoding.c:231: warning: pointer targets in passing argument 1 of âstrlenâ differ in signedness /usr/include/string.h:397: note: expected âconst char *â but argument is of type âunsigned char *â encoding.c:231: warning: pointer targets in passing argument 1 of â__strcspn_c1â differ in signedness /usr/include/bits/string2.h:971: note: expected âconst char *â but argument is of type âunsigned char *â encoding.c:231: warning: pointer targets in passing argument 1 of â__strcspn_c2â differ in signedness /usr/include/bits/string2.h:982: note: expected âconst char *â but argument is of type âunsigned char *â encoding.c:231: warning: pointer targets in passing argument 1 of â__strcspn_c3â differ in signedness /usr/include/bits/string2.h:994: note: expected âconst char *â but argument is of type âunsigned char *â encoding.c:231: warning: pointer targets in passing argument 1 of â__builtin_strcspnâ differ in signedness encoding.c:231: note: expected âconst char *â but argument is of type âunsigned char *â encoding.c:231: warning: pointer targets in passing argument 1 of â__builtin_strcspnâ differ in signedness encoding.c:231: note: expected âconst char *â but argument is of type âunsigned char *â <snip> loadhosts.c: In function âbbh_find_itemâ: loadhosts.c:228: warning: return discards qualifiers from pointer target type loadhosts.c: In function âbbh_itemâ: loadhosts.c:540: warning: pointer targets in passing argument 1 of ânlencodeâ differ in signedness /home/tjyang/hobbitmon/branches/4.3.0/include/../lib/encoding.h:17: note: expected âunsigned char *â but argument is of type âchar *â loadhosts.c:540: warning: pointer targets in passing argument 2 of âaddtobufferâ differ in signedness /home/tjyang/hobbitmon/branches/4.3.0/include/../lib/strfunc.h:16: note: expected âchar *â but argument is of type âunsigned char *â loadhosts.c: In function âbbh_item_idâ: loadhosts.c:619: warning: return discards qualifiers from pointer target type <snip> msort.c: In function âmsortâ: msort.c:119: warning: passing argument 4 of âqsortâ from incompatible pointer type /usr/include/stdlib.h:756: note: expected â__compar_fn_tâ but argument is of type âint (*)(void **, void **)â <snip> sha2.c: In function âmySHA224_Finalâ: sha2.c:972: warning: pointer targets in passing argument 2 of âsha224_finalâ differ in signedness sha2.c:812: note: expected âunsigned char *â but argument is of type âchar *â sha2.c: In function âmySHA256_Finalâ: sha2.c:977: warning: pointer targets in passing argument 2 of âsha256_finalâ differ in signedness sha2.c:417: note: expected âunsigned char *â but argument is of type âchar *â gcc -g -O2 -Wall -Wno-unused -D_REENTRANT -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -DLINUX -I. -I/home/tjyang/hobbitmon/branches/4.3.0/include -DCLIENTONLY=1 -I. -I../include -c -o sig.o sig.c <snip> gcc -g -O2 -Wall -Wno-unused -D_REENTRANT -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -DLINUX -I. -I/home/tjyang/hobbitmon/branches/4.3.0/include -DCLIENTONLY=1 -I. -I../include -DCLIENTONLY -c -o timefunc-client.o timefunc.c ar cr hobbitclient.a osdefs.o cgiurls.o color-client.o digest.o encoding.o environ-client.o errormsg.o holidays.o ipaccess.o loadhosts.o md5.o memory.o misc.o msort.o rbtr.o rmd160c.o sendmsg.o sha1.o sha2.o sig.o stackio.o strfunc.o suid.o timefunc-client.o ranlib hobbitclient.a || echo "" gmake[1]: Leaving directory `/home/tjyang/hobbitmon/branches/4.3.0/lib' CC="gcc" CFLAGS="-g -O2 -Wall -Wno-unused -D_REENTRANT -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -DLINUX -I. -I`pwd`/include -DCLIENTONLY=1" LDFLAGS="" RPATHOPT="-Wl,--rpath," SSLFLAGS="" SSLINCDIR="" SSLLIBS="" NETLIBS="" LIBRTDEF="-lrt" BBHOME="/home/xymon/client" gmake -C common client gmake[1]: Entering directory `/home/tjyang/hobbitmon/branches/4.3.0/common' <snip> gcc -g -O2 -Wall -Wno-unused -D_REENTRANT -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -DLINUX -I. -I/home/tjyang/hobbitmon/branches/4.3.0/include -DCLIENTONLY=1 -c -o bbdigest.o bbdigest.c bbdigest.c: In function âmainâ: bbdigest.c:48: warning: pointer targets in passing argument 2 of âdigest_dataâ differ in signedness /home/tjyang/hobbitmon/branches/4.3.0/include/../lib/digest.h:26: note: expected âunsigned char *â but argument is of type âchar *â gcc -g -O2 -Wall -Wno-unused -D_REENTRANT -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -DLINUX -I. -I/home/tjyang/hobbitmon/branches/4.3.0/include -DCLIENTONLY=1 -o ../client/bbdigest bbdigest.o ../lib/hobbitclient.a -lrt gmake[1]: Leaving directory `/home/tjyang/hobbitmon/branches/4.3.0/common' CC="gcc" CFLAGS="-g -O2 -Wall -Wno-unused -D_REENTRANT -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -DLINUX -I. -I`pwd`/include -DCLIENTONLY=1" LDFLAGS="" RPATHOPT="-Wl,--rpath," SSLLIBS="" NETLIBS="" LIBRTDEF="-lrt" BBHOME="/home/xymon/client" gmake -C build all gmake[1]: Entering directory `/home/tjyang/hobbitmon/branches/4.3.0/build' gcc -o merge-lines -g -O2 -Wall -Wno-unused -D_REENTRANT -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -DLINUX -I. -I/home/tjyang/hobbitmon/branches/4.3.0/include -DCLIENTONLY=1 merge-lines.c gcc -o merge-sects -g -O2 -Wall -Wno-unused -D_REENTRANT -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -DLINUX -I. -I/home/tjyang/hobbitmon/branches/4.3.0/include -DCLIENTONLY=1 merge-sects.c gcc -o setup-newfiles -g -O2 -Wall -Wno-unused -D_REENTRANT -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -DLINUX -I. -I/home/tjyang/hobbitmon/branches/4.3.0/include -DCLIENTONLY=1 -Wl,--rpath, setup-newfiles.c ../lib/hobbitclient.a -lrt setup-newfiles.c: In function âmainâ: setup-newfiles.c:27: warning: pointer targets in assignment differ in signedness setup-newfiles.c:79: warning: pointer targets in passing argument 1 of âstrstrâ differ in signedness /usr/include/string.h:340: note: expected âconst char *â but argument is of type âunsigned char *â gmake[1]: Leaving directory `/home/tjyang/hobbitmon/branches/4.3.0/build' CC="gcc" CFLAGS="-g -O2 -Wall -Wno-unused -D_REENTRANT -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -DLINUX -I. -I`pwd`/include -DCLIENTONLY=1" BBHOME="/home/xymon/client" BBHOSTIP="127.0.0.1" LOCALCLIENT="no" NETLIBS="" LIBRTDEF="-lrt" gmake -C client all gmake[1]: Entering directory `/home/tjyang/hobbitmon/branches/4.3.0/client' <snip> msgcache.c: In function âmainâ: msgcache.c:537: warning: pointer targets in passing argument 3 of âacceptâ differ in signedness /usr/include/sys/socket.h:214: note: expected âsocklen_t * __restrict__â but argument is of type âint *â cat hobbitclient.cfg.DIST | sed -e 's!@BBHOSTIP@!127.0.0.1!g' >hobbitclient.cfg ../build/bb-commands.sh >>hobbitclient.cfg cat clientlaunch.cfg.DIST | sed -e 's!@CLIENTFLAGS@!!g' >clientlaunch.cfg gmake[1]: Leaving directory `/home/tjyang/hobbitmon/branches/4.3.0/client' Build complete. Now run 'gmake install' as root [tjyang@f12 4.3.0]$
Xymon GUI ideas
[edit | edit source]GUI Requirements
[edit | edit source]- Keep cgi+html+tigramenu for legacy support.
- Include modern Javascript GUI framework like extjs or jQuery.
- Provide realtime web GUI update from clients using AJAX.
- Waiting for 1+ minutes to see the changes from web page is barely acceptable but hope to avoid.
From Neil Franken
[edit | edit source]- Use CSS to provide easy theme and resolution change.
- Resolutions:
- Themes:
- Enable fine-grained control on columns in different views.
From T.J. Yang
[edit | edit source]I found following combination of existing opensource software can make up a new GUI for Xymon. End user can still see old cgi+html GUI.
- Use extjs for new GUI and miframe.js to contain old tigra menu GUI in a frame.
- See Xymon Desktop Prototype.
Using command line tool to update this wiki book
[edit | edit source]Installation of mediawiki client in perl
[edit | edit source]- Mediawik command line tool
- A makefile script to automate the hobbit documentation effort.