Cost Function

Cost Function :-

A cost function is plotted based on the following equation,

J(θ0,θ1)
=2m1i=1∑m(hθ(xi)−yi)2  


J(θ0,θ1) - Cost Function
m - No.of input values
hθ(xi) - Value of Hypothesis function on iᵗʰ input.
yi - Actual value on iᵗʰ input.

It is basically the average(mean) of differences between squares of hypothesis value and actual values. As the value of cost function reduces the accuracy will be better.
So we will be trying to keep J(θ₁,θ၀) minimum. (0 in ideal case).
The cost function plot will be a 3D figure with,

θ၀ - x axis
θ₁ - y axis
 J(θ₁,θ၀) - z axis

The graph will look like a set of concave dips and the minimum height of the graph will provide best value of θ₁ and θ၀.

For convenience, we are skipping θ၀ for now and plots θ₁ vs J(θ₁)
Here, h(θ) = xθ₁ and best value for θ₁ is marked in red. One more concept gradient descent will help us to find the minimum value of Cost function.

On Next - Gradient Descent
Location: United States

Comments

Post a Comment

Popular posts from this blog

Unsupervised Learning

Image
In unsupervised learning, we are provided with a dataset and nothing else. There is no outputs, parameters or anything to distinguish the given data. Our aim is to let the machine to learn or create a grouping/classification on its own. Unsupervised learning is comparatively difficult with respect to supervised learning. Consider social networking sites, based on our actions they are filling our feed with posts/media that we would prefer, suggests people we want to follow and a lot of things. These kinds of solutions are done using unsupervised learning. In the figure, social media users are grouped by machine based on some factors which are unknown to the programmer. This could be a simple example of unsupervised learning.
Read more

Automate Blog Post creation using Blogger APIs and Python

Image
This article will discuss the following topics, Blogger's REST APIs. Google's OAuth 2.0 playground. Accessing spreadsheet in Python. Creating blogger posts via Python. An experiment to automate blog post creation when you have structured data. I was searching for IFSC codes for some bank transactions and came across Reserve Bank's website, which has a list of Excel files containing Bank Codes, Contact Info and related details of each bank's branch. This time I will be looking towards Bharat co-operative bank of Mumbai. Here is how the corresponding data looks like. In the above picture, each row represents lots of details about each branch of the Bank. Let's think of creating a list of blog posts where each post gives IFSC codes of a particular branch along with address and contact details. As the first step, I have created a blog in blogger. In the Blogger dashboard, please also note the parameter called blog ID which is a kind of unique identifier
Read more

Setting up Python Flask server on internet via Port forwarding

Image
In this post we will cover topics; Starting a server using Python Flask. Accessing server in Local Network. Adding a Port Forwarding rule in NAT settings. Accessing server in Internet via public IP. Difference between static IP and dynamic IP. Step 1 :- As the first step, we need to setup a server on our system.A server exposes your code to a particular port.Some examples are Apache Tomcat, Spring boot (inbuilt), Python Django (inbuilt), Nginx. Here we have a simple server in Python Flask. For a GET request in root path the server returns a "Hello World!".That's it. Going to start the server on my local IP address(192.168.1.105) at default flask port(5000) using below commands, $export FLASK_APP=flaskTest.py $flask run  --host=192.168.1.105 Step 2 :- For security purpose all ports for external communication is closed by router's firewall by default. So no communication can be done to outside world. For same reason our server won't be
Read more

The beginning of Data Quest

***** Work In Progress ******* Ever since I entered to IT industry, I was hearing about data science machine learning and the miracles happened because of these. On curiosity, I too have started learning some the concepts on these areas. As the first step, I have enrolled in Andrew N G's Machine Learning course. I will be sharing things I have learned in this blog and consider this post as an Index for my learning. Good Luck!!! Definition of Machine Learning  Supervised Learning Linear Regression Cost Function Gradient Descent Unsupervised Learning
Read more

Setting up Jupyter Lab integrated with Python, Julia, R on Windows Subsystem for Linux (Ubuntu)

Image
Every guy gotta favourite OS. But, due to some constraints, all can't use that all the time. Being a Linux user, I had to shift to Windows 10 because of the barrier by MS Office and Dual booting often doesn't work. A few weeks before I learned about Windows Subsystem for Linux and my experience was great. If you are Linux pro stuck in Windows, this could be a relief. Basically, you can run a well-designed minimal version of Ubuntu inside Windows 10. In this article, we will get familiar with, Activation of Windows Subsystem for Linux. Installation of Ubuntu (no GUI) using Microsoft App Store. Configuring Python3, Pip3 and Jupyter Lab. Installation of R in Ubuntu and integration of R with Jupyter Lab. Installation of Julia in Ubuntu along with Jupyter Lab integration. Accessing Windows files with Ubuntu. Installation of Windows Subsystem for Linux Windows don't ship with WSL by default, we need to install it via PowerShell.  Reference -  https://docs.microsoft.co
Read more