Friday, October 4, 2013

Alternative to RDBMS

Have been thinking (and reading) a lot lately about storing data... and am about to conclude that it requires a radical shift in storing data to be able to scale (keeping cost in mind). World is talking about NoSql and its time for me to check-it-out. 

I already have a system in place which works well with sql server but i wanna scale and cut the cost so thinking of either move to mysql or have mongodb along with elastic search.

These are the below options i have : -


Mysql with Elastic Search/Sphinx
  1. We can move to mysql database  (which is very easy by importing).
  2. IDE looks fine to begin with which is workbench
  3. It does have INNODB to support all necessary RDBMS features and now Full text search has been added, which isnt very performant or scalable.
  4. We can integrate sphinx or solr with mysql, challenge is we need to convert the binary data to textual data and then only it can be indexed.
  5. We can also use elastic search which will be independent of database, it'll work as a rest api call.
NoSql (MongoDB) with Elastic Search

  1. A migration project has to be written for sql server, have to check the intricacies.
  2. Elastic search with river works in conjunction with MongoDB 

Starting my POC on second option... Lets keep the fingers crossed.

Saturday, August 29, 2009

Facebook or Twitter

Facebook along with MySpace have been the leaders in social networking portals. Facebook however is trying hard to bridge the gap between them and fame of twitter.

Recent developments in Facebook were paradigm shift to their original approach, they revamped their presentation and this time they concentrated more on status messages just like twitter but little more powerful. Twitter, however has been a micro-messaging tool which became popular cuz of its simplicity and yet being powerful. This internet evolution has become one of the most significant modern trends since it has affected the way in which we do business and communicate with peers.

In last week news Facebook has launched a twitter-app, where in Facebook user can automatically syndicate their posts to Twitter, read more here. When Facebook made an attempt to acquire Twitter, and failed there was a rumor in market that Facebook will take different route to go the Tweet Way. Let’s see how much they will succeed.

Wednesday, August 19, 2009

Power of WCF

WCF (Windows Communication Foundation) is Microsoft's unified programming model for building service-oriented applications that communicate across the web and the enterprise. WCF clearly demarcates development and implementation. There are various Hosting options available and is independent of the run-time environment in which the service is deployed, they are:-
  • Self-Hosting in a Managed Application
  • Managed Windows Services
  • Internet Information Services (IIS)
  • Windows Process Activation Service (WAS)
All the development part lies in the code while the implementation like the binding can be handled in the config file as Microsoft has abstracted a lot of plumbing work reducing the implementation time. By this way developer can concentrate on core logic and WCF takes care of data delivery in the most reliable, secure and high performance fashion depending on situation.

WCF has an integrated Logging mechanism that helps you log traces. In other technologies developer has to write custom solution but in WCF, all that you need to do is to enable trace by changing the config file.

To achieve security mechanism in WCF you have 3 implementation choices:

  1. Transport: Transport security depends on the mechanism that the binding you've selected uses.
  2. Message: Message security means that every message includes the necessary headers and data to keep the message secure.
  3. TransportWithMessageCredential : This choice uses the transport layer to secure the message transfer, while every message includes the rich credentials other services need.
After the launch of modeling edition I feel it gets easy to delegate work in a team. An architect can create a Data Contracts/Relationships, Message Contracts and Service Contracts. After that only the facade layer has to be made with some tweaks here 'n' there. In this way lot of architecture intricacies can be hidden from developer.

WCF does not replace MSMQ, COM+ or Web Services, it provides a declarative infrastructure for all forms of communication to and from the Windows platform. Using WCF, communications happen at designated service endpoints, and an endpoint can implement different protocols (such as Web Service, WS-* SOAP style services), encodings (such as Text, Binary & MTOM), and transports (such as MSMQ, Http, etc.).

With .net 3.5, it becomes even easier to provide RESTful endpoints (JSON, POX, RSS and ATOM). So the real powerful leverage shall be building services that can be consumed by a ASP.net web client as JSON while simultaneously being accessed by a business partner through a php web client using the SOAP protocol (with its full complement of WS-* implementations such as WS-Security, WS-ReliableMessaging, etc.)

Thursday, August 13, 2009

Burden translating Entities to DTO

Well we finished a major sprint 2 months back and we were on a consolidation phase this sprint, solving browser issues, redesigning some pages, working on performance and also looking for some customer centric use-cases.

Ours is a n-tier Architected Enterprise Product which deals with wcf along with nHibernate. At that juncture I did give a lot of thought with one my junior that we end up wasting a lot of time translating Service Entities to our DTO.

I thought of writing a utility with the help of reflection which shall copy the members from one type to another. But then we dint took it up due to various reasons. Both the types should have same property name and type. In our scenario there are plenty of cases where in property names are similar but there are lot of properties which we made nullable in DTO's.

Last week Rick Strahl also wrote about it and it was good to read that there are more people who face similar problems. 3 years back we wrote a utility that shall browse 2 different entities and after maping properties manually used to generate the translaters that was the closest we got to solve the menace.

Am still in thinking mode...

Wednesday, August 12, 2009

Combo of Linked-In and Facebook! You game?

Almost 2 years back when we were about to make first implementation of our recruitment based product we heard networking sites picking up. We at that time did had a LAMP based online community product Campus-Connect, which dealt with campus crowd. Our new product primarily focussed on Recruitment Management for Corporates and Consultants.

Our role models were Maxhire and Taleo, which captured majority of the online recruitment market in US. When facebook became so popular, Taleo aired that they will combine with facebook and give some kind of service. The idea attracted me a lot and i did write a spec of a feature for our product, which never got implemented for some silly reasons.

In recruitment world, Head-hunting is supposed to be the toughest job and getting leads is very costly and hit-ratios are not that exaggerating. So I thought of mining and churn out the leads for each candidate along with some tips to talk depending on the type of lead.

I am still bullish in making something like it... perhaps this is the time I should start working on it.

Tuesday, July 21, 2009

Hello World with WPF!

After a lot of fight with myself am starting to dig deep into wpf, lets see how much attractive is it. Last night i downloaded the toolkit and some reporting examples. Lets see what it comes out to be.

Monday, July 20, 2009

Smart Client -- Is it a Dead Project?

I have been working hands on with Smart Client Software Factory since mid 2006, used to follow Matias, Glenn and few others. Its surely lil time-taking for someone who has not taken design patterns seriously.

Have loved working on it and eventually made a SAAS grade Enterprise Project, and there are still things happening there. I heard Unity coming and things getting change in factories. Have not been too keen in WPF as it would have been costly representation.

I feel disposing of objects is not the best in the factory, and i guess there has to be significant effort to accomplish the same. Just hope something comes new and improved.