Waleed The IT Guy

Data science development is very different from software development, and getting the two to mesh is sometimes like trying to cobble together Tinker Toys with Lincoln Logs.     One data science expert once described the differences as: Software development is “Measure twice; cut once,” while Data Science is “Cut, cut, cut!” The methodologies and processes that support successful software development do not work for data science projects according to one simple observation:   software development  knows , with 100% assurance, the expected outcomes, while data science – through data exploration and hypothesis testing, failing and learning –  discovers those outcomes. First introduced in the blog “ What's The Difference Between BI Analyst and Data Scientist ?”, the Data Science Engagement methodology in Figure 1 supports the rapid exploration, rapid testing, and continuous learning Data Science “Scientific Method [1] ”. Figure   1 :    Data Science ...

Scalability ·          After a web application has been developed, there are still issues that need to be considered when deploying to the internet. A big concern is scalability. An application can work well with only a few users, but it also needs to be able to support many more people accessing data and using the application simultaneously. The vast majority of the time, there is no one best way to scale, but rather a number ways with different trade-offs that should be taken into account. Server Scaling ·          A server can only perform a finite number of tasks per second, measured in hertz. Modern servers and processors often have speeds in gigahertz. The operations being measured are low-level: adding two numbers together, for example. Due to limited server speed, a server can only respond to a limited number of users in a given second. ·        ...