Mounting Particular NAS directory to Linux File System
Now a days, most of the NAS storage devices come with a support to access the storage in multiple ways/protocols for different operating systems. In windows you can map drive option or you can better use ftp and sftp clients like FileZilla. In case of Unix/Linux distros. You can use command line based utility with easy syntax called “mount.cifs” to access remote storage devices. Following example illustrates the usage of above command.
NAS devices facilitate user based restricted acesses to directories. Such directories can be remotely accessed i.e. Read/Write and mounted in a linux filesystem to manage natively.
Let’s mount such directory as below:
1.Create Folder in /mnt to mount remote location in it.Usually mnt directory is preferred to maintain uniformity in mount locations.
mkdir /mnt/shared_data
2.Mount/Connect/Link command :
mount.cifs -o username=typeyournasusername //IPorHostname/shared_data/ /mnt/shared_data
The above command will mount/link NAS directory named “shared_data” with username having authority to access to local directory
“/mnt/shared_data”.You can list the contents using ls command.Here response time would depend upon network bandwidth between local and NAS.
Important Tips:
1.Do not use rm command inside mounted directory,as it will delete the same file from NAS as well.
2.Avoid mounting bigger/parent directories directly, rather use specific directory. As it would be safer in case of disasterous condition like accidental removal/renaming/processing etc..
3.Unmount/Unlink/Safe To Remove/Disconnect :
umount /mnt/shared_data
If it doesnt work due to message like “device is busy ,unable to unmount” please verify and ensure that all files are closed.Retry again , if it still doesnt work use lazy loading option as:
umount -l /mnt/shared_data
Sometimes it takes couple of minutes depending upon mounted directory size, network and local system resource usage.
Extract lines between Pattern using sed and awk
One Liners to extract lines :
1) To extract lines including Pattern :
sed -n ‘/Pattern_Start/ , /Pattern_End/p ‘ Filename
2) To extract lines excluding Pattern :
awk ‘/Pattern_Start/ { p=1; next } /Pattern_End/ {exit} p’ Filename
Find and delete files using “find” shell command
Find and Delete Files in Linux/Unix:
Examples:
1) Find .log files in current directory and delete
$ find . -name “*.log” -type f -exec rm {} \;
2) Find the directories starting with ERO and delete
$ find -name “ERO*” -type d -exec rm {} \;
3) Find .log files in current directory and delete interactively
$ find . -name “*.log” -type f -exec rm -i {} \;
Installing R Packages over proxy authentication
If you are running behind the proxy sever and you need to install the R packages ex : Bioconductor packages first you need to set the proxy environment on the terminal using the command like given below :
export http_proxy= proxy_user_name : proxy_usesr’s_password @ Proxy_IP_Address:Proxy_Port_no.
example :
$export http_proxy=user:password@192.166.100.100:8080
type bash and enter to set the proxy.
similarly you can export ftp_proxy , https_proxy if needed otherwise http_proxy is enough to set.
Installing from the Linux Terminal :
Start R Terminal by pressing R and enter key.
>source("http://bioconductor.org/biocLite.R")
>biocLite("package_name")
or
>install.packages("package_name",dependencies=TRUE) Installing from archive(tar.gz) :
First download the package(tar.gz) from Bioconductor or CRAN(http://cran.r-project.org/).
The go to the download place from terminal and then type:
$R CMD INSTALL tar.gz_package
SSH from Windows 7 using PowerShell
SSH from PowerShell using the SSH.NET library
http://www.powershelladmin.com/wiki/SSH_from_PowerShell_using_the_SSH.NET_library
Awk –helpful
awk '{ if (NF > max) max = NF } END { print max }'
- This program prints the maximum number of fields on any input line.
awk 'length($0) > 80'- This program prints every line longer than 80 characters. The sole rule has a relational expression as its pattern, and has no action (so the default action, printing the record, is used).
awk 'NF > 0'- This program prints every line that has at least one field. This is an easy way to delete blank lines from a file (or rather, to create a new file similar to the old file but from which the blank lines have been deleted).
awk '{ if (NF > 0) print }'- This program also prints every line that has at least one field. Here we allow the rule to match every line, then decide in the action whether to print.
awk 'BEGIN { for (i = 1; i <= 7; i++) print int(101 * rand()) }'- This program prints 7 random numbers from 0 to 100, inclusive.
ls -l files | awk '{ x += $4 } ; END { print "total bytes: " x }'- This program prints the total number of bytes used by files.
expand file | awk '{ if (x < length()) x = length() } END { print "maximum line length is " x }'- This program prints the maximum line length of file. The input is piped through the
expandprogram to change tabs into spaces, so the widths compared are actually the right-margin columns. awk 'BEGIN { FS = ":" } { print $1 | "sort" }' /etc/passwd- This program prints a sorted list of the login names of all users.
awk '{ nlines++ } END { print nlines }'- This programs counts lines in a file.
awk 'END { print NR }'- This program also counts lines in a file, but lets
awkdo the work. awk '{ print NR, $0 }'- This program adds line numbers to all its input files, similar to`cat -n’.
Tweak Gnome Desktop using gnome-tweak-tool
Gnome Tweak Tool is a tool for Gnome Desktop customisation . It has fixes for recent fedora distributions. It can be able to fix bugs like lack of different components such as minimise and maximise buttons , classic application menu extension etc.
First install from terminal Type : sudo yum install gnome-tweak-tool
Then install the extension settings Type : sudo yum install gnome-shell-extensions
Delete file contents using ‘sed’
[Sed] Delete one or more lines from a file
Here is how to remove one or more lines from a file.
Syntax:
sed '{[/]<n>|<string>|<regex>[/]}d' <fileName>
sed '{[/]<adr1>[,<adr2>][/]d' <fileName>
- /…/=delimiters
- n = line number
- string = string found in in line
- regex = regular expression corresponding to the searched pattern
- addr = address of a line (number or pattern )
- d = delete
Examples
Remove the 3rd line:
sed '3d' fileName.txt
Remove the line containing the string “awk”:
sed '/awk/d' filename.txt
Remove the last line:
sed '$d' filename.txt
Remove all empty lines:
sed '/^$/d' filename.txt sed '/./!d' filename.txt
Remove the line matching by a regular expression (by eliminating one containing digital characters, at least 1 digit, located at the end of the line):
sed '/[0-9/][0-9]*$/d' filename.txt
Remove the interval between lines 7 and 9:
sed '7,9d' filename.txt
The same operation as above but replacing the address with parameters:
sed '/-Start/,/-End/d' filename.txt
The above examples are only changed at the display of the file (stdout1= screen).
For permanent changes to the old versions (<4) use a temporary file for GNU sed using the “-i[suffix]”:
sed -i".bak" '3d' filename.txt
How to do Advanced file search in Windows 7?
Here’s a list of search filters you can Type into the search box to narrow things down:
| Filter | Explanation |
| kind: | This will only search for files of the type that you specify. Some examples are document, folder, picture, and calendar. |
| datemodified: | This will search for anything based on the date that they were last modified. Note that the mini-calendar will allow you to Select a range of dates if you hold down the Shift key. |
| datetaken: | Searches for photos based on the day they were captured. |
| datecreated: | Searches for anything created on the specified date or time range. |
| name: | Windows will only search for files by their name, not contents. |
| type: | This will search for files of a specified extension. Some examples are .bmp, .pdf, .doc, and .mp3. This is similar to the “kind:” filter, but much more specific. |
| tags: | This will search for files based on the metadata tags that are included in the file. |
| size: | Search for a file of a specific size, or you can broaden the search by looking for a range of sizes. To make a custom range, put two periods in-between variables. For example: size:=10mb..50mb |
| length: | Searches for audio and video clips by length. |
| authors: | You can enter the username of the person who created a file, and search will only display results by that user. |
Essential Repositories for RedHat(RHEL)/Fedora/CentOS
- EPEL: Extra Packages for Enterprise Linux (or EPEL) is a Fedora Special Interest Group that creates, maintains, and manages a high quality set of additional packages for Enterprise Linux, including, but not limited to, Red Hat Enterprise Linux (RHEL),CentOS and Scientific Linux (SL). http://fedoraproject.org/wiki/EPEL
- RPMforge: RPMforge is a collaboration of Dag and other packagers. They provide over 5000 packages for CentOS, including wine, vlc, mplayer, xmms-mp3, and other popular media tools. It is not part of Red Hat or CentOS but is designed to work with those distributions. http://wiki.centos.org/AdditionalResources/Repositories/RPMForge/
- RPM Fusion :RPM Fusion provides software that the Fedora Project or Red Hat doesn’t want to ship. That software is provided as precompiled RPMs for all current Fedora versions and Red Hat Enterprise Linux 5 and 6; you can use the RPM Fusion repositories with tools like yum and PackageKit.RPM Fusion is a merger of Dribble, Freshrpms, and Livna; our goal is to simplify end-user experience by grouping as much add-on software as possible in a single location. http://rpmfusion.org/
Linux Reader for Windows ,Get access to any files from Windows!
DiskInternals Linux Reader is a new easy way to do this. This program plays the role of a bridge between your Windows and Ext2/Ext3/Ext4, HFS and ReiserFS file systems.
Linux Reader is 100% FREE. Try it now.
ssh over Authenticated proxy in Ubuntu
To connect to the remote Linux system using ssh we have to configure the proxy settings.
1) First install corkscrew by sudo apt-get install corkscrew
2) Create a file vi /home/username/.corkscrew-auth replace username of yours & edit the file by adding your proxy username:password and save the file.
3) Edit the ssh configuration file vi /etc/ssh/ssh_config and append the following line to it and save :
ProxyCommand corkscrew 10.10.10.10 8080 %h %p /home/username/.corkscrew-auth
where replace 10.10.10.10 with your proxy host name , 8080 with the port no,file /home/username/.corkscrew-auth having username and password
Get Linux Hardware Information
FOR RED-HAT/CENTOS /FEDORA :
Memory Information : sudo cat /proc/meminfo
CPU Information : sudo cat /proc/cpuinfo
PCI Information : sudo lspci
For Ubuntu:
All Information : sudo lshw
CPU INFORMATION :
How should I do this? 