### Why is this Deep Q Agent constantly learning just one action?

I’m trying to implement deep q learning in the openai gym “Taxi-v3” environment. But my agant only learns to do one action in every state. What am I doning wrong? Here is the code.

### What activation functions are better for what problems?

I’ve been reading on neural network architecture and all I read bout activation functions is that using a non-linear sigmoid “more accurately reflects real life” or for functions like hard limits it reflects “the brain neural networks more accurately.” For what type of problems are activation functions better for?

### Convert a PAC-learning algorithm into another one which requires no knowledge of the parameter

This is part of a problem in the book Foundations of Machine Learning(page 28). You can refer to chapter 2 for the notations. Consider a family of concept classes $\left\{\mathcal{C}_{s}\right\}_{s}$ where $\mathcal{C}_{s}$ is the set of concepts in $\mathcal{C}$ with size at most $s .$ Suppose we have a PAC-learning algorithm $\mathcal{A}$ that can be…

### Why we multiply probabilities with support to obtain Q-values in Distributional C51 algorithm?

In ‘Deep Reinforcement Learning Hands-On’ book and chapter about Distributional C51 algorithm I’m reading, that to obtain Q-values from the distribution I need to calculate the weighted sum of the normalized distribution and atom’s values. Why I have to multiply that distribution with support? How does it work and what happening there?

### Comparing EEG data with Accelerometer Data in 1 algorithm

I have EEG data as well as accelerometer data and I am trying to figure out how to compare them so I can feed them into one algorithm. Any literature, articles or information will be appreciated greatly. Thanks

### Logistic Regression Weight Training

I am new to machine learning , so please excuse me if I misuse any terms or words . I am trying to use Logistic Regression to make a spam filter, but i am having trouble understanding the weight update part.I have processed my email dataset ,and i have an attribute vector of the top…

### How many ways are there to perform image segmentation?

I’m new in Artificial Intelligence and I want to do image segmentation. Searching I have found this ways: Digital image processing (I have read it in this book: Digital Image Processing, 4th edition). Convolutional neural networks. Is there something else that I can use?