1. cat nm.access.log | grep contact/index-s.html > ~kdyer/public_html/PUENTE/contactS

2. zcat nm.access.log.* | grep contact/index-s.html >> ~kdyer/public_html/PUENTE/contactS

3. (for i in `cat contactS | awk '{print $1}' | sort | uniq` ; host $i ) > contactS.IP

4. awk '{print $NF}' < contactS.IP > contactS.addresses

5. rev contactS.addresses | sort | rev

find the number of unknowns

6. grep -E 'NXDOMAIN|SERVFAIL|reached' contactS.addresses | wc (need to reverse this if it is going to work)
 
 
 
 

What Allan gave me:

in zsh:

(for i in `cat <input-file> | awk '{print $1}' | sort | uniq` ; host $i ) >
<output-file>

awk '{print $NF}' < <output-file-from-above> | grep -v -E 'NXDOMAIN|SERVFAIL'

NEW METHOD:

zsh

0. count total hits

cat faqE | wc

1. lookup IP numbers

(for i in `cat faqE | awk '{print $1}' | sort | uniq` ; host $i ) > faqE.addresses

2.  sort, removed duplicates, reverse, sort

cat faqE.addresses| sort | uniq | rev | sort > faqE.address.ur

3. count unique hits

cat faqE.addresses.ur | wc

4. count failed lookups

grep -E 'NIAMODXN|LIAFVRES|dehcaer|LIAF' early.S.addresses.ur | wc

5.  count occurances

 cat faqE.address.urs | cut -c 1-4 | rev | sort | uniq -ic | grep us