mobile and gis dev notes » linux

VIM cheatsheet

rupert — Sat, 07 May 2011 07:03:18 +0000

set nocompatible
set nu
set expandtab
 
"this will change tab to spaces
set ts=2 
set shiftwidth=2
set expandtab
 
set hlsearch
syntax on
 
"Use TAB to complete when typing words, else inserts TABs as usual.
"Uses dictionary and source files to find matching words to complete.
 
"See help completion for source,
"Note: usual completion is on  but more trouble to press all the time.
"Never type the same word twice and maybe learn a new spellings!
"Use the Linux dictionary when spelling is in doubt.
"Window users can copy the file to their machine.
function! Tab_Or_Complete()
  if col('.')>1 && strpart( getline('.'), col('.')-2, 3 ) =~ '^\w'
    return "\"
  else 
    return "\"
  endif
endfunction
:inoremap  =Tab_Or_Complete()
:set dictionary="/usr/dict/words"
 
set numberwidth=5
set cmdheight=2
"To map: imap ;f foobar => Type f; foobar will be inserted
 
"RSPEC Where ! is execute command. % is the current file
":!rspec %
 
"Map RSPEC test to ,t
":map ,t :w\|!rspec %

Subversion

rupert — Sat, 31 Oct 2009 22:22:01 +0000

This post will contain a summary of information regarding subversion scattered from old posts.

Installation on Debian

1. Packages

#apt-get install subversion
#apt-get install libapache2-svn

2. Login as root then create the repository.

#cd /data
#svnadmin create /repos --fs-type fsfs

3. Set the permissions

#groupadd subversion
#addgroup rupert subversion
#addgroup www-data subversion
 
#chown -Rf www-data:subversion /data/repos
#chmod -Rf 770 repos

It’s better to set the necessary users and groups that would use subversion now. Later on, if we need to checkout using svn+ssh and setup a passwordless svn, then we won’t get permission issues.

4. In /etc/apache2/sites-available/2rmobile, add this to the configuration.

        
        DAV svn
        SVNPath /data/repos
        SVNAutoversioning on
        AuthType Basic
        AuthName "SVN - Your Project"
        AuthUserFile /data/svn-auth-file
        Require valid-user

5. Enable the webdav module then restart apache.

#a2enmod dav
#a2enmod dav_svn
#/etc/init.d/apache2 restart

Passwordless SVN

On your local macbook pro (mbp), we need to generate the ssh keys from the local machine, upload it to the remote machine and append it in the authorized_keys.

On the local machine:

#ssh-keygen -t rsa
...
#cd /Users/rupert/.ssh
#scp -r id_rsa.pub rupert@2rmobile.com:/home/rupert/.ssh/id_rsa_mbp.pub

On the remote machine:

#cd ~/.ssh
#touch authorized_keys
#cat id_rsa_mbp.pub >> authorized_keys

Test on the local machine by doing

ssh rupert@2rmobile.com

. In my mbp, a dialog box from keychain is asking for the password. To circumvent this, we can add the passphrase to our identities.

#ssh-add -K
... enter the passphrase twice...
#ssh-add -k (adds it to the identities)
#ssh-add -l (lists the identities)

Now the benefits of having a passwordless svn:
- ofcourse it saves us a lot of time
- rails capistrano deployment

References:
http://www.howtoforge.com/debian_subversion_websvn

Subversion Tips and Tricks

http://subversion.tigris.org/faq.html#ssh-authorized-keys-trick

1. Checking out using svn+ssh and having passwordless ssh authentication. My personal favorite when working with personal projects since I have full control.

svn co svn+ssh://www.2rmobile.com/data/repos/web/rails/halalan2010 halalan2010

But for work projects, I normally use webdav

svn co "http://www.2rmobile.com/repos/web/halalan2010" halalan2010

2. svn+ssh on a custom or different port other than 22. I have my ssh on 2210, so we need to tell svn+ssh to use 2210

vim ~/.subversion/config
 41 [tunnels]
 42 ### Configure svn protocol tunnel schemes here.  By default, only
....
 53 ### built-in ssh scheme were not predefined, it could be defined
 54 ### as:
 55 ssh = $SVN_SSH ssh -p 2210

http://www.techper.net/2009/01/11/changing-port-number-of-svnssh-subversion-protocol/

3. svn diff – shows you the changes in a directory. This is useful for creating patches.

svn diff -r HEAD
svn st -q

3. svn switch oldURL to newURL - very useful when I’m working at home or in the office, since the svn server has a public/private IP.

4. svn log – shows you who committed and why (from the messages)

5. ignoring specific set of files in a directory.

svn propset svn:ignore "*.log" log

6. ignoring a whole directory.

svn propset svn:ignore dirname .

7. ignoring using an ignore file (.ignore.txt) in a directory (sample.xcodeproj).

*.pbxuser
*.mode1v3
xcuserdata

svn propset svn:ignore - F .ignore.txt .

Rails Note #13: RubyonRails + Oracle on Linux (i386 / x64)

rupert — Thu, 11 Dec 2008 00:53:48 +0000

In summary, install Oracle Instant Client and try to run sqlplus. If sqlplus connects to the oracle sid then go ahead and install the rails adapters for oracle. What is important to note here, is to install the oracle-instantclient for the architecture of your machine.. I have tested this on Debian Lenny (i386) and CentOS5 (x64)

1. Download from http://www.oracle.com/technology/software/tech/oci/instantclient/

a. oracle-instantclient-basic-10.2.0.4-1.i386
b. oracle-instantclient-devel-10.2.0.4-1.i386
c. oracle-instantclient-sqlplus-10.2.0.4-1.i386

2. Unzip everything to /opt/oracle/instantclient . You should have something like the ff:

[root@csapp1 instantclient]# ls -la
total 102704
drwxr-xr-x 3 root root     4096 Dec 10 21:54 .
drwxr-xr-x 3 root root     4096 Dec 10 22:03 ..
-rw-r--r-- 1 root root      228 Dec 10 21:52 BASIC_README
-r--r--r-- 1 root root  1609607 Dec 10 21:52 classes12.jar
-rwxr-xr-x 1 root root    67542 Dec 10 21:52 genezi
-r--r--r-- 1 root root     1525 Dec 10 21:52 glogin.sql
lrwxrwxrwx 1 root root       17 Dec 10 21:54 libclntsh.so -> libclntsh.so.10.1
-rwxr-xr-x 1 root root 21038613 Dec 10 21:52 libclntsh.so.10.1
-r-xr-xr-x 1 root root  3796601 Dec 10 21:52 libnnz10.so
-rwxr-xr-x 1 root root  1664116 Dec 10 21:52 libocci.so.10.1
-rwxr-xr-x 1 root root 72674185 Dec 10 21:52 libociei.so
-r-xr-xr-x 1 root root   138033 Dec 10 21:52 libocijdbc10.so
-r-xr-xr-x 1 root root  1435561 Dec 10 21:52 libsqlplusic.so
-r-xr-xr-x 1 root root   997409 Dec 10 21:52 libsqlplus.so
-r--r--r-- 1 root root  1555682 Dec 10 21:52 ojdbc14.jar
drwxr-xr-x 4 root root     4096 Dec 10 21:52 sdk
-r-xr-xr-x 1 root root     7773 Dec 10 21:52 sqlplus
-rw-r--r-- 1 root root      232 Dec 10 21:52 SQLPLUS_README
-rw-r--r-- 1 root root      516 Dec 10 21:53 tnsnames.ora
[root@csapp1 instantclient]#

3. Make a symbolic link for libclntsh.so.10.1 as shown above.

4. Create the Oracle Environment variables

export ORACLE_HOME=/opt/oracle/instantclient
export TNS_ADMIN=$ORACLE_HOME
export LD_LIBRARY_PATH=$ORACLE_HOME:$LD_LIBRARY_PATH
export DYLD_LIBRARY_PATH=$ORACLE_HOME
export PATH=$PATH:$ORACLE_HOME

5. At this point, you should have oracle-instantclient properly installed. You can test by running sqlplus.

[root@csapp1 instantclient]# sqlplus
 
SQL*Plus: Release 10.2.0.4.0 - Production on Thu Dec 11 11:47:40 2008
 
Copyright (c) 1982, 2007, Oracle.  All Rights Reserved.

NOTE: Sometimes you will get a SEGMENTATION FAULT. If so, try to open a new shell with the environment variables loaded and do an sqlplus in a directory which is not /opt/oracle/instantclient.

6. Install the oracle adapter for rails

7. gem install ruby-oci8

8. gem install oracle_enhanced-adapter –source=”http://gems.rubyonrails.org/”

activerecord-oracle-adapter (1.0.0.9250)
activerecord-oracle_enhanced-adapter (1.1.8)

NOTE: Try to look for the latest gems, the source above is at the time of this writing so it might change.

9. Test using irb

[root@csapp1 instantclient]# irb
irb(main):001:0> require 'rubygems'
=> true
irb(main):002:0> require 'oci8'
=> true
irb(main):003:0>

Chinese Debian Repository

rupert — Fri, 07 Nov 2008 01:34:33 +0000

Its been a long time I have not updated debian. Now, debian.cn99.com is not working. However, there is a new mirror in town.. www.anheng.com.cn.

http://www.debian.org/mirror/list

Post Install Apache2.x, ColdFusion 8

rupert — Wed, 28 May 2008 13:42:37 +0000

After binding Apache2.x and ColdFusion 8, I find it very useful to follow the post-install instructions below:

1. Copying ColdFusion Admin directory to /wwwroot (webroot)

# ln -s /var/www /wwwroot
# cp -Rf /opt/coldfusion8/wwwroot/CFIDE /wwwroot/
# rm /wwwroot/index.html
# cd /wwwroot
# ln -s CFIDE cfide

2. Adding index.cfm to DirectoryIndex.

# vim /etc/apache2/mods-available/dir.conf
DirectoryIndex index.html index.cgi index.pl index.php index.xhtml index.htm index.cfm

3. Restart apache

/etc/init.d/apache2 stop 
/etc/init.d/apache2 start

4. Browse Admin page for the first time

Installing Postgresql, Postgis, pgRouting on Debian

rupert — Sun, 25 May 2008 03:55:57 +0000

Operating System: Debian sid

Versions:

postgres 8.3.1
postgis 1.3.3
pgRouting1.02

1. Install base system and ssh

#vi /etc/apt/sources.list to include
deb http://debian.cn99.com/debian etch main
deb-src http://debian.cn99.com/debian etch main
#apt-get update
#apt-get upgrade libc6

2. Install the required packages for postgres8.3 and postgis1.3.3

#apt-get install sudo nmap telnet
#apt-get install python2.5 python2.5-dev python-setuptools
#apt-get install g++
#apt-get install build-essential cmake ibboost-graph-dev
#apt-get install libreadline5 libreadline5-dev
#apt-get install zlib-bin zlib1g-dev
#apt-get install libkrb5-dev
#apt-get install libcurl3
#apt-get install libssl-dev
#apt-get install postgresql-8.3
#apt-get install postgresql-8.3-postgis
#apt-get install postgresql-server-dev-8.3

3. Installing pgRouting

# tar -zxvf pgRouting-1.02.tgz
# cmake .
# make 
# make install

Installing Mapserver on Debian (reprise)

rupert — Fri, 28 Mar 2008 11:31:43 +0000

As noted from my previous blog post regarding Mapserver on Debian, you don’t get AGG with Mapserver when installing directly from Debian packages. Thus, it would be better to install Mapserver by source. However, debian still helps because it would install all the necessary libraries needed for compiling mapserver.

./configure \
--with-agg \
--with-jpeg \
--with-gd \
--with-freetype \
--with-png \
--with-ogr \
--with-proj \
--with-gdal \
--with-httpd=/usr/sbin/apache2 \
--with-tiff \
--with-wfs \
--with-wcs \
--with-threads \
--with-wmsclient \
--with-wfsclient \
--with-geos \
--with-postgis \
--enable-debug

When I started installing yesterday, I did not know which packages/libraries are installed in my box. I dove off immediately by running my configure.sh above and received an error: Could not find gd.h or libgd.a/libgd.so in /usr/local..

The best way to figure out if you’re ready is reading thru the configure output.

checking for gcc... gcc
checking for C compiler default output file name... a.out
checking whether the C compiler works... yes
checking whether we are cross compiling... no
checking for suffix of executables...
checking for suffix of object files... o
checking whether we are using the GNU C compiler... yes
checking whether gcc accepts -g... yes
checking for gcc option to accept ANSI C... none needed
checking for g++... g++
checking whether we are using the GNU C++ compiler... yes
checking whether g++ accepts -g... yes
checking for ranlib... ranlib
checking for flex... no
checking for lex... no
checking for yywrap in -lfl... no
checking for yywrap in -ll... no
checking for bison... no
checking for byacc... no
checking if compiler supports -R... no
checking if compiler supports -Wl,-rpath,... yes
checking for exp in -lm... yes
checking for __gxx_personality_v0 in -lstdc++... yes
checking how to run the C preprocessor... gcc -E
checking for egrep... grep -E
checking for ANSI C header files... yes
checking for strcasecmp... yes
checking for strncasecmp... yes
checking for strdup... yes
checking for strlcat... no
checking for vsnprintf... yes
MapServer Version from mapserver.h: '5.0.2'
configure: checking where FreeType 2.x is installed...
checking for freetype-config... /usr/bin/freetype-config
using libfreetype from -lfreetype -lz
checking for FT_Init_FreeType in -lfreetype... yes
using libfreetype -lfreetype from system libs.
configure: checking where Zlib is installed...
checking for zlibVersion in -lz... yes
using libz from system libs (-DUSE_ZLIB).
configure: checking where PNG is installed...
checking for png_init_io in -lpng... yes
using libpng from system libs.
configure: checking whether we should include JPEG support...
checking for jpeg_read_header in -ljpeg... yes
using libjpeg from system libs.
configure: checking where libXpm is installed...
checking for XpmFreeXpmImage in -lXpm... yes
using libXpm from system libs.
configure: checking where libiconv is installed...
checking for iconv_open in -lc... yes
checking for libiconv_open in -liconv... no
using libiconv from system libs.
libiconv found. Enabling internationalization (-DUSE_ICONV)
configure: checking for GD 2.0.16 or higher...
checking for gdFontCacheSetup in -lgd... yes
using libgd 2.0.16 (or higher) from system libs (-L/usr/lib -lgd -ljpeg -lfreetype -lpng -lz -lXpm -lX11 ).
checking for gdImageCreate in -lgd... yes
checking for gdImageGif in -lgd... yes
checking for gdImagePng in -lgd... yes
checking for gdImageJpeg in -lgd... yes
checking for gdImageWBMP in -lgd... yes
checking for gdImageStringFT in -lgd... yes
checking for gdImageOpenPolygon in -lgd... yes
checking for gdImageGifPtr in -lgd... yes
checking for gdFontGetTiny in -lgd... yes
using GD ( -DUSE_GD_GIF -DUSE_GD_PNG -DUSE_GD_JPEG -DUSE_GD_WBMP -DUSE_GD_FT -DGD_HAS_FTEX_XSHOW -DGD_HAS_GDIMAGEGIFPTR -DGD_HAS_GETBITMAPFONTS) from system libs.
configure: checking whether we should include PDF support...
checking for PDF_setlinewidth in -lpdf... no
checking for PDF_setrgbcolor in -lpdf... no
checking for PDF_moveto in -lpdf... no
checking for PDF_curveto in -lpdf... no
checking for PDF_show_xy in -lpdf... no
checking for PDF_load_font in -lpdf... no
libpdf not found or too old... PDF support not included.
checking if AGG support requested... looking for agg libs in /usr
using libagg from /usr
using libaggfontfreetype from /usr
configure: checking whether we should include EPPL7 support...
including EPPL7 support.
configure: checking whether we should include PROJ.4 support...
checking for pj_init in -lproj... yes
checking for pj_transform in -lproj... yes
using PROJ.4 from system libs.
configure: checking whether we should include thread safe support...
checking for pthread_create in -lpthread... yes
using -lpthread from system libs.
configure: checking whether we should include ESRI SDE support...
ESRI SDE support not requested.
checking if GEOS support requested... yes
checking for geos-config... /usr/bin/geos-config
checking for GEOS version &gt;= 2.2.2... yes. Found version 2.2.3
configure: checking whether we should include OGR support...
checking for gdal-config... /usr/bin/gdal-config
OGR enabled (-DUSE_OGR).
checking if GDAL support requested... yes
checking checking ms JPEG output... no we, have GDAL available.
configure: checking whether we should include TIFF support...
checking for TIFFOpen in -ltiff... yes
using libtiff from system libs.
checking if PostGIS support requested... yes
checking for pg_config... /usr/bin/pg_config
yes, user supplied pg_config
checking if MyGIS support requested... no
checking if OracleSpatial support requested... no
checking if MING/Flash support requested... no
configure: checking whether we should include WMS Server support...
OGC WMS compatibility enabled (-DUSE_WMS_SVR).
configure: checking whether we should include WFS Server support...
OGC WFS Server support enabled (-DUSE_WFS_SVR).
configure: checking whether we should include WCS Server support...
OGC WCS Server support enabled (-DUSE_WCS_SVR).
configure: checking whether we should include WMS Client Connections support...
configure: checking whether we should include WFS Client Connections support...
configure: checking whether we should include OGC SOS Server support...
configure: checking for curl-config...
checking for curl-config... /usr/bin/curl-config
found libcurl version 7.18.0
OGC WMS Client Connections enabled (-DUSE_WMS_LYR).
OGC WFS Client Connections enabled (-DUSE_WFS_LYR).
configure: checking for xml2-config...
configure: checking whether FastCGI support should be enabled...
FastCGI support not enabled.
configure: checking HTTPD server (Apache) version...
using user-supplied httpd (/usr/sbin/apache2)
/usr/sbin/apache2 version is Apache/2.2.8 (2002008).
Your system is apparently running Apache/2.2.8. Setting stderr to non-blocking for msDebug() due to Apache 2.x bug (see MapServer bug 458 or Apache bug 22030).
Compiling with fast MS_NINT
checking compiler warnings... basic
configure: checking whether we should enable debug features...
Enabling debug features: -g in CFLAGS.
configure: checking for PHP/MapScript module options...
PHP/MapScript module not configured.
checking for g++ -shared ... yes
checking if --enable-runpath requested... no
checking if --with-java-include-os-name specified... no, autodetected linux
configure: creating ./config.status
config.status: creating Makefile
config.status: creating mapscript/java/Makefile
config.status: creating mapscript/csharp/Makefile
MapServer is now configured for
-------------- Compiler Info -------------
C compiler: gcc -g -O2 -fPIC -Wall
C++ compiler: g++ -g -O2 -fPIC -Wall
Debug: -g -DNEED_NONBLOCKING_STDERR
Generic NINT:
Threading support: -DUSE_THREAD
-------------- Renderer Settings ---------
zlib support: -DUSE_ZLIB
png support:
jpeg support:
iconv support: -DUSE_ICONV
AGG support: -DUSE_AGG
AGG Freetype support: -laggfontfreetype
Ming(flash) support:
PDFLib support:
-------------- Data Format Drivers -------
native tiff support: -DUSE_TIFF
PostGIS support: -DUSE_POSTGIS
Proj.4 support: -DUSE_PROJ
EPPL7 support: -DUSE_EPPL
ArcSDE support:
OGR support: -DUSE_OGR
GDAL support: -DUSE_GDAL
GEOS support: -DUSE_GEOS
Oracle Spatial support:
FastCGI support:
-------------- OGC Services --------------
WMS Server: -DUSE_WMS_SVR
WMS Client: -DUSE_WMS_LYR
WFS Server: -DUSE_WFS_SVR
WFS Client: -DUSE_WMS_LYR
WCS Server: -DUSE_WCS_SVR
SOS Server:
-------------- MapScript -----------------
PHP MapScript: no

I was able to weed out the problem above by checking on the libraries noted with “yes” above if they are installed or not. To overcome this, I needed to install the ff debian packages on ‘lenny(testing)’:

libagg-dev libgd2-xpm libgd2-xpm-dev libtiff4 libtiff4-dev libpng libpng-dev libxpm4 libxpm4-dev libfreetype6-dev libapache2-mod-python python-imaging

Results:

debsexy:/usr/lib/cgi-bin# ./mapserv -v
MapServer version 5.0.2 OUTPUT=GIF OUTPUT=PNG OUTPUT=JPEG OUTPUT=WBMP OUTPUT=SVG SUPPORTS=PROJ SUPPORTS=AGG SUPPORTS=FREETYPE SUPPORTS=WMS_SERVER SUPPORTS=WMS_CLIENT SUPPORTS=WFS_SERVER SUPPORTS=WFS_CLIENT SUPPORTS=WCS_SERVER SUPPORTS=THREADS SUPPORTS=GEOS INPUT=TIFF INPUT=EPPL7 INPUT=POSTGIS INPUT=OGR INPUT=GDAL INPUT=SHAPEFILE

Installing Firefox on Linux (Debian)

rupert — Wed, 05 Mar 2008 00:17:10 +0000

I read somewhere that Firefox was renamed to Iceweasel on Debian. Thus, I can’t install the Google Toolbar for it. So here are the steps for installing Firefox manually in a linux system.

1. Download the source from Mozilla’s site

2. Unpack the source. tar -zxvf firefox-2.0.0.12.tar.gz

3. Create a shell script pointing to the binary of the source.

#!/bin/sh
cd /home/rupert/firefox
./firefox &amp;

4. Grant execute rights to the script.

5. Right click on the top-panel and click “Add To Panel”

6. Choose “Custom Application Launcher” and specify the ff:

Name: "Firefox"
Command: /home/rupert/firefox.sh
Comment: Mozilla Firefox Browser.

7. Click on the Left Button to specify an icon to the launcher.

8. Click on Browse and navigate to /home/rupert/firefox/icons

9. Let’s install Google Toolbar.

10. Restart Firefox.

If you want to install the Adobe Flash Plugin, then download the player (install_flash_player_9_linux.tar.gz) from Adobe.

# tar -zxvf install_flash_player_9_linux.tar.gz
# cd /home/rupert/install_flash_player_9_linux.tar.gz
# ./flashplayer-installer

Debian Command CheatSheet

rupert — Mon, 03 Mar 2008 20:56:40 +0000

If you need to setup/install Debian. Please follow this post.

1. Removing a service from startup

# update-rc.d -f samba remove

2. Installing a service on boot
update-rc.d myServiceName start 80 2 3 4 5 . stop 15 0 1 6

3. Specifying Debian Sources
#vim /etc/apt/sources.list
#SID:
deb http://debian.cn99.com/debian unstable main
deb-src http://debian.cn99.com/debian unstable main

#LENNY:
#deb http://debian.cn99.com/debian testing main
#deb-src http://debian.cn99.com/debian testing main

#ETCH
#deb http://debian.cn99.com/debian etch main
#deb-src http://debian.cn99.com/debian etch main

4. Searching for a package from the repository

apt-cache search [package name]

5. Installing a package

apt-get install [package name]

6. Purging an installed/configured package

aptitude purge [package name]

7. Upgrade a debian distro

apt-get dist-upgrade

Excluding Subversion directories/files when using GREP

rupert — Fri, 08 Feb 2008 16:15:36 +0000

I’ve been searching this from big-o-Goog from a long time now (two months?). During development, instead of searching the keyword from Eclipse, I still feel very much in control when I am using the commandline–using grep. Courtesy of this blog post, a big time and eye strain saver when doing a grep in a directory full with svn base files and directories is using WCGREP.

Installing Subversion on Debian

rupert — Sat, 26 Jan 2008 17:26:15 +0000

I was greeted with “No space left on device” on my cron log. Turns out that my svn server obviously ran out of disk space. The old svn server was running on CentOS4.3, Subversion 1.3.2, Trac-0.11.devxxx. I decided to migrate the svn data to a new server, so I installed Debian4.01 on a small server with 72 GB HD, no partitions (just / and swap, so the svn have room to grow…). Here are the steps I took for the migration:

A. A fresh start…
1. Installed Debian. Fixed network and ssh.
2. apt-get install apache2
3. apt-get install subversion
4. apt-get install python python-setuptools python-mysqldb python-subversion
5. apt-get install libapache2-svn libapache2-mod-python

B. Making SVN work…
1. svnadmin create /repos –fs-type fsfs

2. Since I have a fresh apache configuration, I edited it accordingly from /etc/apache2/mods-available/dav_svn.conf:

#SVN dir

  DAV svn
  SVNPath /repos
  SVNAutoversioning on
  AuthType Basic
  AuthName "SVN - Your Project"
  AuthUserFile /repos/svn-auth-file
  Require valid-user

3. Restart apache

4. To test if svn is running, import a project inside the repository.
svn import -m "initial import" /tmp/project http://127.0.0.1/repos/project

C. Migrating the data

After I got my fresh debian svn machine, I need to move the svn data and trac to the new server. http://svnbook.red-bean.com/nightly/en/svn.reposadmin.html

1. Transfer /repos/svn-auth-file and /repos/svn-authorization-file to the new server
2. Transferred trac.tar.gz (/var/www/trac) to the new server

To move the svn data from one server to another, I tried the ff choices…
1. svnadmin dump /repos /reposbak. Will work if disk space is not an issue. My /repos is 25 GB, and my other 30 GB partition was wiped out, even though the dump was not finished yet.

2. svnadmin hotcopy --clean-logs /repos /repos2. Accdg to the docs, this is exactly the same repository without the BdB logs. I then transferred the hotcopy from choice 2 above to the new server and works flawlessly to my surprise. So now, I still have all my revisions

http://bealers.com/2008/01/01/installing-trac-on-debian-etch/
http://trac.edgewall.org/wiki/TracOnDebianSarge
http://trac.edgewall.org/wiki/TracUpgrade
http://trac.edgewall.org/wiki/TracInstall
http://trac.edgewall.org/wiki/TracModPython

SquirrelMail SMTP Authentication

rupert — Fri, 04 Jan 2008 13:16:44 +0000

Just a quick note to myself… A co-worker just notified me that they cannot send email using the web interface–squirrelmail.

squirrelmail Server replied: 553 sorry, that domain isn't in my list of allowed rcpthosts (#5.5.3 - chkuser)

This qmailrocks forum thread gives a quick workaround. Just set “SMTP AUTHENTICATION” to login as noted below.

/usr/share/squirrelmail/config/config.php $no_list_for_subscribe = false; $smtp_auth_mech = 'login'; $imap_auth_mech = 'login'; $use_imap_tls = false;

Installing R on Windows and Debian

rupert — Fri, 16 Nov 2007 01:15:59 +0000

‘R’ is a statistical package. For an overview, please go to www.r-project.org
My intention was to remove the point outliers from a given set of point geometries.

I just recently installed R both on my Windows XP and Debian. Regina’s www.bostongis.com is an excellent tutorial in getting involved with R. I do suggest you head first to PLR Part 1: Up and Running with PL/R (PLR) in PostgreSQL: An almost Idiot’s Guide to get you started.

The install instructions for Windows works flawlessly. I have to hold back to R-2.5 though as I plan to use RPy (Python for R), see details below. To install ‘R’ in Debian, there’s a couple of settings that we need to take care of…

1. Install r-base
sudo apt-get install r-base

2. Install plr on postgres
sudo apt-get install postgresql-8.2-plr

3. Using R in a database
psql -d beijing -U lbs -h 127.0.0.1 < /usr/share/postgresql/8.2/plr.sql

4. Set the R_HOME environment variable
/etc/postgresql/8.2/main/environment
R_HOME='/usr/lib/R'

5. Restart Debian.

RPy, R for Python, is another alternative to use R in Python. I installed it both in Windows and Debian. Note that I reverted to R-2.5 on Windows to be compatible with RPy. For Debian, Im currently using R-2.6.

For the Windows Binary Installation,

1. Read the RPy Main Site

2. Install prerequisites:

- NumPy
- Win32 Extensions Download

3. Afterwards, install the main package, RPy Download

In Debian, its a straight forward…sudo apt-get install python-rpy

Serving ASP pages in Linux

rupert — Tue, 13 Nov 2007 19:55:19 +0000

I never intended to do such a thing as what the title describes. However, since we need it at work temporarily, I have to crack up my linux skills to set this up. Principal reference is http://www.apache-asp.org/config.html.

In Debian,

1. install libapache2-mod-perl2 + libapache-asp-perl

sudo apt-get install libapache2-mod-perl2 sudo apt-get install libapache-asp-perl

2. configuration includes:
sudo vi /etc/apache2/sites-available/default

 76     PerlModule  Apache::ASP
 77      
 78        SetHandler  perl-script
 79        PerlHandler Apache::ASP
 80        PerlSetVar  Global .
 81        PerlSetVar  StateDir /data/asp
 82

3. Restart apache.

4. Make sure you have the correct permissions to: /data/asp
drwxrwxr-x 4 www-data www-data 4096 2007-11-13 15:33 asp

5. If you encounter the problems:

[Tue Nov 13 15:12:36 2007] [error] [client 127.0.0.1] Can't locate object method "get" via package "APR::Table" at /usr/share/perl5/Apache/ASP.pm line       2016.\n at /usr/share/perl5/Apache/ASP.pm line 2016\n\tApache::ASP::get_dir_config('APR::Table=HASH(0x81d96f8)', 'Global') called at /usr/share/perl5/A      pache/ASP.pm line 275\n\tApache::ASP::new('Apache::ASP', 'Apache2::RequestRec=SCALAR(0x81d9764)', '/data/wwwroot/asp/test.asp') called at /usr/share/pe      rl5/Apache/ASP.pm line 183\n\tApache::ASP::handler('Apache2::RequestRec=SCALAR(0x81d9764)') called at -e line 0\n\teval {...} called at -e line 0\n, re      ferer: http://127.0.0.1/asp/

Read nable-post. which patches /usr/share/perl5/Apache/ASP.pm as follows:

The lines 65-71:
   if($ENV{MOD_PERL}) {
   $ModPerl2 = ($mod_perl::VERSION >;= 1.99);
   if($ModPerl2) {
       eval "use Apache::ASP::ApacheCommon ();";
       die($@) if $@;
   }
   }
 
become
   if($ENV{MOD_PERL}) {
   $ModPerl2 = ($mod_perl::VERSION >;= 1.99);
   my $ver = $mod_perl::VERSION;
   if ($ver eq "") { $ver = $ENV{MOD_PERL_API_VERSION}; }
   $ModPerl2 = ($ver >;= 1.99);
   if($ModPerl2) {
       eval "use Apache::ASP::ApacheCommon ();";
       die($@) if $@;
   }
   }

6. If Step 5 still doesn’t work.

a. And this to /etc/apache2/conf.d/perl.conf:

PerlRequire /etc/apache2/startup.pl

b. startup.pl
#!/usr/bin/perl use Apache2::compat; 1;

7. To test. Paste the ff in test.asp under your webroot.

  -- sample here -->
 
  For loop incrementing font size:
 
  &lt;% for(1..5) { %&gt;
	-- iterated html text -->
	<font size="<%=$_%>"> Size = &lt;%=$_%&gt; font> 
  &lt;% } %&gt;
 
  -- end sample here -->

Too many authentication failures for user

rupert — Sat, 10 Nov 2007 23:29:00 +0000

Found this finally.. http://netthink.com/archives/191. On a quick note, edit ssh_config not sshd_config.

You could also try debugging ssh while connecting, through “-v” switch. For example:

ssh -v rupert@192.168.1.12

Qmail Error 451

rupert — Tue, 30 Oct 2007 13:43:41 +0000

Finally, I was able to nail down the PBL problems I had with my qmail server. I was able to use Outlook 2007/2003 to use my pop/smtp. To use Outlook 2007, you should have the ff settings:

1. Tools -> Account Settings.
2. Click on the desired account
3. Click on “More Settings” button
4. In the outgoing server tab, ensure that you have “My outgoing server (SMTP) requires authentication” checked.
5. In the outgoing server tab, ensure that you have “Use same settings as my incoming mail server” checked.
6. In the Advanced Tab, you can set it to “Auto”

Spamhaus problem. 451 http://www.spamhaus.org/query/bl?ip=219.142.133.68.
You can remove spamhaus when you send email, but that’s quite dangerous. If you want to completely remove the PBL checking,

1. Check your blacklist settings. You can remove the line below, or change it to an PBL listings like http://forum.qmailrocks.org/archive/index.php/t-3103.html

more /var/qmail/control/blacklist
-r sbl.spamhaus.org

2. Restart qmail

/etc/init.d/qmailctl stop
/etc/init.d/qmailctl start

553 sorry, that domain isn’t in my list of allowed rcpthosts (#5.5.3 – chkuser)
Here’s a good description of the problem on relaying. http://www.palomine.net/qmail/relaying.html
. If you “enabled smtp authentication” and used your settings for loggin-in, then this would not happen. I experienced this when I changed my Outlook 2007 settings to “Log on to incoming mail server before sending mail”.

References: http://www.peternew.co.uk/?p=85
http://www.spamhaus.org/sbl/howtouse.html

Debian MySQL

rupert — Mon, 29 Oct 2007 22:21:27 +0000

A default install of mysql on debian would have bind-address set to 127.0.0.1. This is why you can’t accept remote connections to your mysql. In order to establish remote connections to mysql on debian servers, please comment the bind-address as shown below.

 42 language    = /usr/share/mysql/english
 43 skip-external-locking
 44 #
 45 # Instead of skip-networking the default is now to listen only on
 46 # localhost which is more compatible and is not less secure.
 47 #bind-address = 127.0.0.1
 48 #

SVN Group Policies

rupert — Mon, 06 Aug 2007 21:00:03 +0000

httpd.conf:
++++++++++++++++++++++++++++++++++++++

DAV svn
SVNPath /repos

AuthzSVNAccessFile /repos/svn-authorization-file

AuthType Basic
AuthName “Subversion repository”
AuthUserFile /repos/svn-auth-file
Require valid-user
/repos/svn-authorization-file:
++++++++++++++++++++++++++++++++++++++
[repos:/]
rupert=rw
andrew=rw
tony=rw

[repos:/web/cybersoftjs/trunk]
anonymous=r

[repos:/web/poimgr]
jake=r

NTPD Sync

rupert — Mon, 06 Aug 2007 18:29:57 +0000

For desktops, I do have ntpd installed to sync the time…

1. apt-get install ntpdate

2. /etc/init.d/ntpd stop

3. ntpdate clock.fmt.he.net

Note: You need to stop ntpd before doing an ntpdate..

Debian Howto: Installing Mapserver

rupert — Tue, 31 Jul 2007 22:51:04 +0000

By default, we can install mapserver using etch stable from a debian mirror using apt-get. Final results were almost close as expected, however, I need mapserver with TIFF support to be able to display my satellite images. Thus, recompilation is necessary. Below is the binary version difference for both installation procedures.

Nevertheless, it is worth noting that ‘apt-get’ significantly boost the installation of mapserver. I highly suggest to install mapserver using apt-get and use source compilation only if necessary.

a) mapserver installed using apt-get

rupert-debian:/usr/lib/cgi-bin# ./mapserv -v MapServer version 4.10.2 OUTPUT=GIF OUTPUT=PNG OUTPUT=JPEG OUTPUT=WBMP OUTPUT=SVG SUPPORTS=PROJ SUPPORTS=FREETYPE SUPPORTS=WMS_SERVER SUPPORTS=WMS_CLIENT SUPPORTS=WFS_SERVER SUPPORTS=WFS_CLIENT SUPPORTS=WCS_SERVER SUPPORTS=THREADS SUPPORTS=GEOS INPUT=TIFF INPUT=EPPL7 INPUT=POSTGIS INPUT=OGR INPUT=GDAL INPUT=SHAPEFILE DEBUG=MSDEBUG

Installation instructions for a:

1. apt-get install g++ libgd2-xpm libgd2-xpm-dev libcurl3 zlib1g-dev libgd-dev libtiff4 libtiff4-dev  libapache2-mod-python python-imaging  
 
2. apt-get install php5-cgi php5-common php5-curl php5-dev php5-gd php5-mysql php5-pgsql php5-sqlite php5-xsl libapache2-mod-php5
 
3. apt-get install python2.5 python2.5-dev python2.5-examples
 
4. apt-get install mysql-client-5.0 mysql-server-5.0 mytop mysql-admin mysql-admin-common libmysqlclient15-dev libdbd-mysql-perl libdbd-mysql-ruby mtop
 
5. apt-get install postgresql-common postgresql-8.2 postgresql-client-8.2 postgresql-contrib-8.2 postgresql-8.2-plr postgresql-8.2-plruby postgresql-8.2-postgis postgresql-plperl-8.2 postgresql-plpython-8.2 postgresql-pltcl-8.2 libpq4 
 
6.  apt-get install gdal-bin cgi-mapserver mapserver-bin mapserver-doc perl-mapscript php5-mapscript python-mapscript

b. mapserver compiled

rupert-debian:/usr/lib/cgi-bin# ./mapserv_default -v MapServer version 4.10.0 OUTPUT=GIF OUTPUT=PNG OUTPUT=JPEG OUTPUT=WBMP OUTPUT=SVG SUPPORTS=PROJ SUPPORTS=FREETYPE SUPPORTS=WMS_SERVER SUPPORTS=WMS_CLIENT SUPPORTS=WFS_SERVER SUPPORTS=WFS_CLIENT SUPPORTS=WCS_SERVER SUPPORTS=THREADS SUPPORTS=GEOS INPUT=EPPL7 INPUT=POSTGIS INPUT=OGR INPUT=GDAL INPUT=SHAPEFILE DEBUG=MSDEBUG

Installation instructions for b:

#tar -zxvf geos-3.0.0rc4
#./configure
#make
#make install
 
#modify /etc/apt/sources.list and uncomment testing
deb http://mirrors.geekbone.org/debian testing main
deb-src  http://mirrors.geekbone.org/debian testing main
 
deb http://mirrors.geekbone.org/debian etch main
deb-src  http://mirrors.geekbone.org/debian etch main
 
deb http://security.debian.org/ etch/updates main contrib
deb-src http://security.debian.org/ etch/updates main contrib
 
#apt-get update
 
#apt-get install postgresql-8.2-postgis
 
#tar -zxvf mapserver-4.10.2.tar.gz
#./configure \
--with-jpeg \
--with-gd \
--with-freetype \
--with-png \
--with-ogr \
--with-proj \
--with-gdal \
--with-httpd=/usr/sbin/apache2 \
--with-tiff \
--with-wfs \
--with-wcs \
--with-threads \
--with-wmsclient \
--with-wfsclient \
--with-geos \
--with-postgis \
--enable-debug
#make
#make install
#cp -Rf mapserv /usr/local/cgi-bin/