# (Solved Homework): Computer exercises Several of the exercises use the data in the following table.

Computer exercises
Several of the exercises use the data in the following table.

Section 5.4

1. Consider basic gradient descent (Algorithm 1) and Newton’s algorithm (Algorithm 2) applied to the data in the tables.

(a) Apply both to the three-dimensional data in categories ω1 and ω3. For the gradient descent use η(k) = 0.1. Plot the criterion function as function of the iteration number.

(b) Estimate the total number of mathematical operations in the two algorithms.

(c) Plot the convergence time versus learning rate. What is the minimum learning rate that fails to lead to convergence?

MAIN.M

% Storing the values in seperate matrices

W1 = dataSet(:, 1);

w3 = dataSet(:, 2);

% Do you want feature normalization?

normalization = true;

% Applying mean normalization to our dataset

if (normalization)

maxX = max(W1);
minX = min(W1);
W1= (W1 - maxX) / (maxX - minX);

End

% Running gradient descent on the data

% 'w1' is our input matrix

% 'w3' is our output matrix

% 'parameters' is a matrix containing our initial theta and slope

parameters = [0; 0];

learningRate = 0.1;

iteration = 1500;

[parameters, criterionHistory] = gradient(w1, w3, parameters, learningRate, iteration);
% Plotting our final hypothesis

figure;

plot(min(w1 (:, 2)):max(w1 (:, 2)), parameters(1) + parameters(2) * (min(w1 (:, 2)):max(w1 (:, 2))));

hold on;
% Plotting our criterion function on a different figure to see how we did

figure;

plot(criterionHistory, 1:iteration);

% Finally predicting the output of the provided input

input = 120;

if (normalization)
input = (input - maxX) / (maxX - minX);
end

output = parameters(1) + parameters(2) * input;

disp(output);

function [ parameters, criterionHistory ] = gradient(w1, w3, parameters, learningRate, iteration )

% Getting the length of our dataset

m = length(w3);

% Creating a matrix of zeros for storing our criterion function history

criterionHistory = zeros(iteration, 1);

for i = 1:iteration

% Calculating the transpose of our hypothesis

h = (w1* parameters – w3′;

% Updating the parameters

parameters(1) = parameters(1) – learningRate * (1/m) * h * w1(:, 1);

parameters(2) = parameters(2) – learningRate * (1/m) * h * w1 (:, 2);

% Keeping track of the criterion function

criterionHistory(i) = criterion(w1, w3, parameters);

end

criterion.m

parameters(1) = parameters(1) - learningRate * (1/m) * h * w1(:, 1);
parameters(2) = parameters(2) - learningRate * (1/m) * h * w1(:, 2);
function [ criterion ] = criterion( w1, w3, parameters )

%   Calculates the criterion function

criterion = (w1 * parameters – w3)' * (w1 * parameters – w3) / (2 * length(w3));

end
Order NOW for a 10% Discount
Pages (550 words)
Approximate price: -

Why Us?

Top Quality and Well-Researched Papers

All ourbpapers are written from scratch. In fact, Clients who ask for paraphrasing services are highly discouraged. We have writers ready to craft any paper from scratch and deliver quality ahead of time.

Our writers keeps you posted on your papers progress - providing you with paper outline/draft. You are also at liberty to communicate directly with your writer.

Free Unlimited Revisions

If you think we missed something, send your order for a free revision. You have 10 days to submit the order for review after you have received the final document. You can do this yourself after logging into your personal account or by contacting our support.

Prompt Delivery and 100% Money-Back-Guarantee

All papers are always delivered on time, in many cases quite ahead of time. In case we need more time to master your paper, we may contact you regarding the deadline extension. In case you cannot provide us with more time, a 100% refund is guaranteed.

Original & Confidential

We use several writing tools checks to ensure that all documents you receive are free from plagiarism. Our editors carefully review all quotations in the text. We also promise maximum confidentiality in all of our services.

Our support agents are available 24 hours a day 7 days a week and committed to providing you with the best customer experience. Get in touch whenever you need any assistance.

Try it now!

## Calculate the price of your order

Total price:
\$0.00

How it works?

Fill in the order form and provide all details of your assignment.

Proceed with the payment

Choose the payment system that suits you most.

Our Services

No need to work on your paper at night. Sleep tight, we will cover your back. We offer all kinds of writing services.

## Essay Writing Service

No matter what kind of academic paper you need and how urgent you need it, you are welcome to choose your academic level and the type of your paper at an affordable price. We take care of all your paper needs and give a 24/7 customer care support system.