Scrapping a web page from a website

Let's drool over a URLScrapper class, which can be used to scrap or read a web page.
It connects to web page using the URL class, and then reads the web page over a socket.
Java makes this whole operation pretty simple as demonstrated below. This class can help you pull up information from any web page and then add pick and choose capability to your app using Xpath api.

import java.net.*;
import java.io.*;

public class URLScrapper {

public static void main(String args[]){
String line;
URL url = null;
URLConnection urlConn = null;

Processing vast amounts of data - hadoop

How do we create well managed, scalable applications that process large amounts of data.
The answer is use software platform like - Apache hadoop

Hadoop can reliably store and process large amount of data.
It distributes data and processing across clusters.
Enables real time parallel processing.
Enables fail over.

For more information check out the real stuff at: http://hadoop.apache.org/core/

Happy Processing !!!

Your financial checklist

If you are in your late 20's or early 30's, hopefully married or blissfully single it's high time you have your own financial checklist. So let's get started, by taking a Q&A route.

Do you know your average monthly/yearly expenses?
If not, it's time to go back to school.

Do you have a 8-10 month emergency fund, to fulfill your bare minimum monthly expenses if you are just not earning a regular salary?
If not, it's high time to start building up a 8-10 month emergency fund.

How to plan your insurance

When it comes to the financial matter's of life most of us are either ignorant about it, as we are busy flirting around with our current paycheck's or too dumb enough to understand the financial jargon's. Most of us invest the way our parent's did or our friend's do now. The law of the land is if you have a bunch of smart friend's who are good at planning their investment and safeguards against the risk, you would have done reasonably well till now.

How much should your insure yourself for?

Should it depend on
savings/investments you make every year?

Java runtime memory usage

It is often required to monitor the memory usage of your java application when it's deployed. There are a number of monitoring tools both licensed/open source which can be plugged in your app to monitor the application performance. This could be the thread usage, memory usage, properties etc.

The most common monitoring requirement is for the memory usage of your app. Memory usage pattern of your app can provide good insights to the application performance and scalability enhancements when required.

Java's runtime memory usage can be logged or monitored using the RuntimeMXBean class.

Invoking sqlldr in java

There is a frequent requirement to load data from a flat file into the Oracle DB. Although one can use the novice approach of reading a file, and updating the data in the Oracle DB table using a standard JDBC approach, but that alas is novice and is not good for high performance data loads. Creep in SQL Loader.

Syndicate content