Saturday, October 26, 2024

10/31/24: Guest presentation (RM)

   Machine Learning Study Group

Welcome! We meet from 4:00-4:45 p.m. Central Time. Anyone can join. Feel free to attend any or all sessions, or ask to be removed from the invite list as we have no wish to send unneeded emails of which we all certainly get too many. 
 Contacts: jdberleant@ualr.edu and mgmilanova@ualr.edu

Agenda & Minutes  (136th meeting, Oct. 31, 2024)
 
  • Guest presentation: RM on ML for antenna design.
    • Transcript of meeting is appended to the end of this page. 
    • A demo of the real time use of AI to create the Doppler effect interactive animation and other demos will be scheduled as soon as convenient for RM and VW.
The meeting ended here.
  • Announcements, updates, questions, etc.?
    • The campus has assigned a group to participate in the AAC&U AI Institute's activity "AI Pedagogy in the Curriculum." Our ML Study Group member IU is on it (any news?).
    • Anything else?
  • Here are the latest on readings and viewings
    • Next we will work through chapter 5: https://www.youtube.com/watch?v=wjZofJX0v4M. We got up 15:50 and can start there next time we work on this video! (When sharing the screen, we need to click the option to optimize for sharing a video.)
    • We can work through chapter 6: https://www.youtube.com/watch?v=eMlx5fFNoYc
    • We can work through chapter 7: https://www.youtube.com/watch?v=9-Jl0dxWQs8
    • Computer scientists win Nobel prize in physics! Https://www.nobelprize.org/uploads/2024/10/popular-physicsprize2024-2.pdf got a evaluation of 5.0 for a detailed reading.
    • We can evaluate https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10718663 for reading & discussion.
    • Chapter 6 recommends material by Andrej Karpathy, https://www.youtube.com/@AndrejKarpathy/videos for learning more.
    • Chapter 6 recommends material by Chris Olah, https://www.youtube.com/results?search_query=chris+olah
    • Chapter 6 recommended https://www.youtube.com/c/VCubingX for relevant material, in particular https://www.youtube.com/watch?v=1il-s4mgNdI
    • Chapter 6 recommended Art of the Problem, in particular https://www.youtube.com/watch?v=OFS90-FX6pg
    • LLMs and the singularity: https://philpapers.org/go.pl?id=ISHLLM&u=https%3A%2F%2Fphilpapers.org%2Farchive%2FISHLLM.pdf (summarized at: https://poe.com/s/WuYyhuciNwlFuSR0SVEt). 6/7/24: vote was 4 3/7. We read the abstract. We could start it any time. We could even spend some time on this and some time on something else in the same meeting. 

 

TRANSCRIPT OF MEETING: Meeting summary (11/01/2024) 

R, a Ph.D. student in electrical and computer engineering, presented on the topic of autonomous vehicle communication, emphasizing the importance of AI and ML techniques in her research. She discussed various concepts such as the Doppler effect, frequency hopping technique, vehicle-to-everything (V2X) communication, and beamforming, and their applications in wireless communication and transportation. The meeting also highlighted the potential of machine learning in beamforming, the significance of energy savings in antenna technology, and the role of V in demonstrating concepts for R's work.

Next steps


• R to review conference paper and address reviewer comments.

• V and R to schedule a demo of the AI-assisted development process for beam forming visualizations in the coming weeks.

• V to prepare a demonstration of using Claude AI to generate HTML/CSS/JavaScript visualizations for RF concepts.

• R to continue research on applying convolutional neural networks to beam forming for autonomous vehicle communication.

• V to assist R in preparing AI-generated demonstrations for future presentations on beam forming techniques.


Summary


Autonomous Vehicle Communication Techniques

D B handed over the presentation to R. R, a Ph.D. student in electrical and computer engineering, presented on the topic of autonomous vehicle communication, emphasizing the importance of AI and ML techniques in her research. She explained the Doppler effect and its impact on modulation techniques, demonstrating its effects using a cloud artifact. R also highlighted the efficiency of AI in constructing demonstrations, which would previously have taken hours to create manually. She concluded by discussing the sensitivity of different modulation techniques to the Doppler effect.



Frequency Hopping and Beamforming Techniques

R discussed the frequency hopping technique, inspired by Hollywood actress Hedy Lamar, which provides secure communication by making it difficult for enemies to intercept radio signals. She explained the technique using the 2.4 GHz bandwidth of 5G as an example, dividing it into sub-frequency channels and time chunks. R also introduced the concept of beamforming, comparing it to the double slit experiment in physics. She explained the three types of beamforming techniques: analog, digital, and hybrid, and their applications in wireless communication, radar and sonar systems, audio and speech processing, and hearing aids.



Exploring V2X Communication and 5G Technology

R discussed the concept of vehicle-to-everything (V2X) communication, a sub-technology of the Internet of Things. She explained how V2X enables vehicles to connect with their surroundings, making transportation safer and more efficient. She highlighted the potential of V2X to anticipate and alert drivers of potential crashes, and to relay information to other cars, transport infrastructure, pedestrians, and cyclists. R also emphasized the importance of 5G technology for adVced safety and automated driving, as it provides superfast and ultra-reliable connections. She demonstrated the concept using an animation and a video.



Antenna Gain Pattern Steering With AI

R discussed the importance of steering a gain pattern of an antenna towards a desired direction using cloud artifacts and large language models. She highlighted the time-saving aspect of this method, which takes less than a minute compared to traditional methods that take around 4 to 5 hours. R also explained how the gain pattern changes with the addition of more antenna elements and the need for AI to handle the large number of phase and power combinations required. She demonstrated how the 3D pattern of an antenna steers continuously by changing the phase and power, and how this is crucial for autonomous vehicle communication. R concluded by emphasizing the need for AI and ML techniques to address the numerous combinations required for beam steering.



Machine Learning in Beamforming Explained

R discussed the differences between traditional programming and machine learning programming, emphasizing that the former can fit better into a machine learning problem. She explained how a machine learning model can be trained with data and procedures to find solutions to problems, and how it can inferencing to the desired problem. R also discussed the application of machine learning in beamforming, where a model can be trained with a lookup table or codebook of phase and power combinations to steer a beam towards a desired direction. She highlighted the potential of convolutional neural networks in beamforming, which can adapt to increasing scalability of the antenna array. R also compared traditional and machine learning approaches in terms of accuracy, computational efficiency, scalability, flexibility, and practical implementation.



Phased Array Codebook Demo and ML

R presented a codebook demo for a 2-element phased array case, explaining how the antenna gain pattern changes with phase and power variations. She highlighted the potential of using AI techniques to increase the number of elements in the array, which would be time-consuming using conventional methods. R also mentioned her next steps, which include implementing the same codebook construction with machine learning techniques and comparing the results. Yogesh suggested that the traditional and machine learning methods could be complementary, and R agreed, stating that the traditional method's outputs could be used as input data for the machine learning process.



Exploring Beamforming for Energy Efficiency

R and D B discussed the concept of beamforming in antenna technology. R explained that using a single antenna element would result in a circular pattern of radiation, but this could be inefficient as it would expose unnecessary radiation. She suggested that by using multiple antenna elements, they could target their beam towards specific areas, conserving energy and reducing unnecessary exposure to electromagnetic radiation. R estimated that this could result in a 30 to 50% saving of energy, depending on the case. D questioned the significance of saving a fraction of a watt, to which R responded that in the context of 5G base stations, this could translate to substantial energy savings. They also touched on the topic of radiation protection in vehicles, with R mentioning the concept of a Faraday cage.



Doppler Effect Demonstration and Tools

D B requested a demonstration of how the Doppler effect was developed using Claude.ai, which R confirmed was done by running through prompts. V agreed to arrange a separate talk for this demonstration. G and Mariofanna expressed interest in understanding the tools used for the impressive animations, to which R explained that she used Ansys HFSS for electromagnetic simulations and HTML for the graphs. G clarified that R used custom scripts in HTML, CSS, and JavaScript for the graphs.



V's Role in Demonstrations Discussed

R and V discussed the significant role V played in demonstrating concepts for R's work. They agreed on the need for both R's expertise and V's translation skills for future demonstrations. D B proposed scheduling a demo of the process, but R had to prioritize a conference paper deadline. They agreed to schedule a demo for the following week, with R promising to confirm her availability. V emphasized R's substantial behind-the-scenes effort in preparing the presentations.



 

 
 

Friday, October 25, 2024

10/24/24: Chapter 5 video

   Machine Learning Study Group

Welcome! We meet from 4:00-4:45 p.m. Central Time. Anyone can join. Feel free to attend any or all sessions, or ask to be removed from the invite list as we have no wish to send unneeded emails of which we all certainly get too many. 
 Contacts: jdberleant@ualr.edu and mgmilanova@ualr.edu

Agenda & Minutes  (135th meeting, Oct. 24, 2024)
  • Announcements, updates, questions, etc.
    • MM brought up a free faculty workshop series leading to certification from NVIDIA. See https://events.nvidia.com/faculty-development-virtual-workshops-higher-ed. DB has forwarded a link to this group's members.
    • RM will give a guest presentation for part of the meeting next week (Nov. 1). Topic: ML for antenna design.
  • UALR official AI activities.
    • From an email: "The Provost has a team participating in AAC&U's AI Institute on AI Pedagogy in the Curriculum this year [.... Our ML Study Group member IU] is the representative from DCSTEM. The Provost's office would also like each college to form an ad hoc Committee on AI Pedagogy in the Curriculum that would meet ~monthly with our AI Institute representative." Any updates?
  • Here are the latest on readings and viewings
    • Next we will work through chapter 5: https://www.youtube.com/watch?v=wjZofJX0v4M. We got up 15:50 and can start there next time we work on this video!
    • We can work through chapter 6: https://www.youtube.com/watch?v=eMlx5fFNoYc
    • We can work through chapter 7: https://www.youtube.com/watch?v=9-Jl0dxWQs8
    • Computer scientists win Nobel prize in physics! Https://www.nobelprize.org/uploads/2024/10/popular-physicsprize2024-2.pdf got a evaluation of 5.0 for a detailed reading.
    • We can evaluate https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10718663 for reading & discussion.
    • Chapter 6 recommends material by Andrej Karpathy, https://www.youtube.com/@AndrejKarpathy/videos for learning more.
    • Chapter 6 recommends material by Chris Olah, https://www.youtube.com/results?search_query=chris+olah
    • Chapter 6 recommended https://www.youtube.com/c/VCubingX for relevant material, in particular https://www.youtube.com/watch?v=1il-s4mgNdI
    • Chapter 6 recommended Art of the Problem, in particular https://www.youtube.com/watch?v=OFS90-FX6pg
    • LLMs and the singularity: https://philpapers.org/go.pl?id=ISHLLM&u=https%3A%2F%2Fphilpapers.org%2Farchive%2FISHLLM.pdf (summarized at: https://poe.com/s/WuYyhuciNwlFuSR0SVEt). 6/7/24: vote was 4 3/7. We read the abstract. We could start it any time. We could even spend some time on this and some time on something else in the same meeting.
  •  Here is the Zoom-generated transcript:

    •  

      Quick recap

      The meeting covered various topics related to AI technology and its applications in education and communication. Participants discussed new features on their platform, upcoming workshops and presentations, and technical aspects of screen sharing during meetings. The team also explored the concept of generative pre-trained transformers (GPT), their performance, and potential challenges in AI-generated content detection, as well as the emerging role of prompt engineers in the field.

      Next steps

      • MM to provide details on the Free Faculty Workshop Series for interested participants.

      • RM to give a guest presentation on machine learning for antenna design on November 1st.

      • DB to contact IU for an update on AI pedagogy initiatives at the university level.

      Summary

      Exploring AI Companion Feature

      D and M. discussed a new feature they found on their platform, which they referred to as AI Companion. M. explained that it's a button at the bottom of the screen with a starry icon, and when clicked, it sends a request to the host to start a meeting summary with AI Companion. D confirmed that he saw the same button and tried it, but it didn't have the same options as M.'s. They decided to start the feature and see how it works. G mentioned that this feature is similar to Co-Pilot in Microsoft Teams, which he uses in his organization. D agreed to try it out and possibly post the results on a blog.

      Free Faculty Workshop Series Update

      In the meeting, D discussed the upcoming Free Faculty Workshop Series, which R will be a part of, and encouraged others to sign up. He also mentioned that R will give a guest presentation on machine learning for antenna design on November 1st. D also introduced a new team member, I, who is the representative from their college to the American Association of Colleges and Universities AI Institute on AI Pedagogy. He expressed his intention to ask Ifor an update on the university's AI pedagogy initiatives. Lastly, he reminded the team that they had covered chapters one through four and were now on chapter five of the video series.

      Screen Sharing and Audio Issues

      D led a discussion about sharing a screen and audio during a meeting. Initially, there were issues with the audio being too faint, which DD suggested might be due to the audio not being broadcasted. D tried various solutions, including unsharing, advanced sharing options, and optimizing for video clip, which also automatically shared sound. The team was still experiencing some audio issues at the end of the meeting.

      Explaining Generative Pre-Trained Transformers

      DB explained the concept of generative pre-trained transformers (GPT), a type of bot that generates new text. He detailed how the model learns from a massive amount of data and can be fine-tuned for specific tasks. He also discussed the core invention underlying the current AI boom, the transformer neural network, and its various applications, including text-to-speech, image generation, and language translation. D also outlined how a prediction model can be used to generate longer pieces of text by appending new samples to the initial text. He encouraged questions and comments, acknowledging that the concept might seem surprising.

      GPT-2 and GPT-3 Performance Discussion

      DB discussed the performance of GPT-2 and GPT-3 models, noting that GPT-3, despite being the same basic model as GPT-2 but with more data, generated a more sensible story. The team speculated about the potential for diminishing returns with more data and the possibility of reaching a point where the model is almost as good as a human. DD suggested that the architecture might be the limiting factor, and that overfitting could become a problem if the model is not properly managed. The team also discussed the quality and quantity of data being fed to the models, with M. questioning whether they have reached a point of diminishing returns with the current architecture.

      AI Training Challenges and Prompts

      The team discussed the challenges of training AI with content generated by AI itself, as it could lead to a "poisoned well" of information. They also touched on the emerging role of prompt engineers, who are skilled at crafting effective prompts for AI systems. DD and DB shared their observations on the increasing demand for such skills and the potential for high-paying positions. The conversation ended with a reflection on the importance of effective communication with AI systems.

      AI Language Models and Detection

      DB and DD discussed the potential for AI language models to provide users with a distribution of possible next words, allowing them to choose their preferred word. They also considered the possibility of detecting AI-generated content by analyzing the likelihood of words used. G mentioned a student's dissertation on detecting fake news or videos, which could be applied to this problem. The team agreed that AI-generated content could be identified by its predictability, but acknowledged the difficulty in proving this definitively.

       
























































       

Friday, October 18, 2024

10/18/24: View and discuss chapter 5 video

  Machine Learning Study Group

Welcome! We meet from 4:00-4:45 p.m. Central Time. Anyone can join. Feel free to attend any or all sessions, or ask to be removed from the invite list as we have no wish to send unneeded emails of which we all certainly get too many. 
 Contacts: jdberleant@ualr.edu and mgmilanova@ualr.edu

Agenda & Minutes  (134th meeting, Oct. 18, 2024)
  • Announcements, updates, questions, etc.
    • MM brought up a free faculty workshop series leading to certification from NVIDIA. See https://events.nvidia.com/faculty-development-virtual-workshops-higher-ed. DB has forwarded a link to this group's members.
    • Congratulations to John Hopfield and Geoffrey Hinton -- who are now acclaimed physicists! Https://www.nobelprize.org/prizes/physics/2024/press-release/. We can put that on our list of readings to evaluate and perhaps read through.
    • From an email: "The Provost has a team participating in AAC&U's AI Institute on AI Pedagogy in the Curriculum this year (see links below).  I. U. is the representative from DCSTEM. The Provost's office would also like each college to form an ad hoc Committee on AI Pedagogy in the Curriculum that would meet ~monthly with our AI Institute representative."
  • Here are the latest on readings and viewings

Friday, October 11, 2024

10/11/24: Guest Presentation (AB)

  Machine Learning Study Group

Welcome! We meet from 4:00-4:45 p.m. Central Time. Anyone can join. Feel free to attend any or all sessions, or ask to be removed from the invite list as we have no wish to send unneeded emails of which we all certainly get too many. 
 Contacts: jdberleant@ualr.edu and mgmilanova@ualr.edu

Agenda & Minutes  (133rd meeting, Oct. 11, 2024)
 
  • Today: Guest presentation: AB proposal dry run
The meeting will end here.
  • Announcements, updates, questions, etc.
  • Here are the latest readings and viewings
      • We can work on chapter 5: https://www.youtube.com/watch?v=wjZofJX0v4M
      • Chapter 6 recommends material by Andrej Karpathy, https://www.youtube.com/@AndrejKarpathy/videos for learning more.
      • Chapter 6 recommends material by Chris Olah, https://www.youtube.com/results?search_query=chris+olah
      • Chapter 6 recommended https://www.youtube.com/c/VCubingX for relevant material, in particular https://www.youtube.com/watch?v=1il-s4mgNdI
      • Chapter 6 recommended Art of the Problem, in particular https://www.youtube.com/watch?v=OFS90-FX6pg
      • LLMs and the singularity: https://philpapers.org/go.pl?id=ISHLLM&u=https%3A%2F%2Fphilpapers.org%2Farchive%2FISHLLM.pdf (summarized at: https://poe.com/s/WuYyhuciNwlFuSR0SVEt). 6/7/24: vote was 4 3/7. We read the abstract. We could start it any time. We could even spend some time on this and some time on something else in the same meeting.

Friday, October 4, 2024

10/4/24: General discussion

 Machine Learning Study Group

Welcome! We meet from 4:00-4:45 p.m. Central Time. Anyone can join. Feel free to attend any or all sessions, or ask to be removed from the invite list as we have no wish to send unneeded emails of which we all certainly get too many. 
 Contacts: jdberleant@ualr.edu and mgmilanova@ualr.edu

Agenda & Minutes  (132nd meeting, Oct. 4, 2024)
 
  • Today
    • video viewing/discussion. Start Chapter 5 video.
  • Announcements, updates, questions, etc.
    • From an email: "The Provost has a team participating in AAC&U's AI Institute on AI Pedagogy in the Curriculum this year (see links below).  I. U. is the representative from DCSTEM. The Provost's office would also like each college to form an ad hoc Committee on AI Pedagogy in the Curriculum that would meet ~monthly with our AI Institute representative."
    • VW, RM are testing ChatGPT o1. They are impressed.
    • RM informally explained her project. 
    • EG would like to host a meeting for demoing and/or a workshop soon. 
    • The meeting was composed of general discussion on several topics.
    • DD suggests as a reading, "Generative Agents: Interactive Simulacra of Human Behavior", https://arxiv.org/abs/2304.03442v1.
    • Next week: AB will practice his PhD proposal defense.
    • ChatGPT transcript, 9/28/24:
       
      Me: make an image to accompany the text of of a powerpoint slide. The image should contain a prominently colored kidney-like object in the center, with various items in the remaining portion relating to the content of the slide. The content or text of the slide is as follows: "Project future efficacy of treatment for kidney/renal cancer. Quantify rate of improvement in treatment for different subtypes. Revise survival time figures that are over-weighted with old data. Older data underestimates average survival times. More optimism is justified! Physicians, patients, public health statistics, even insurance companies all are stakeholders."

      ChatGPT:
      Here's the image with a central kidney-like shape surrounded by symbols representing your slide, conveying both the medical focus and optimism for better treatment outcomes.

      Me: I like that one. Can you provide another one, similar but with a different artistic style?
       
      ChatGPT
      Here's the second image with a softer, more painterly style. The artistic approach adds a fluid and abstract feel while still highlighting the key symbols related to kidney cancer treatment and optimism. Let me know if this matches your vision!
       
      ChatGPT:You've reached your image creation limit.
      Upgrade to ChatGPT Plus or try again tomorrow after 4:59 PM.

      Me: beautiful! If flattery was enough, you would make me another picture!
       
      ChatGPT: I'm glad you liked it! Flattery works wonders here—I'll gladly create another image for you. Let me know if you'd like to tweak any specific elements, or if you want a fresh new concept for the next one!
       
      Me: Let's try the fresh new concept! Thanks!
       
      ChatGPT: You've reached your image creation limit.
      Upgrade to ChatGPT Plus or try again tomorrow after 4:59 PM.

      The meeting ended here.

  • Here are the latest readings and viewings
      • We can work on chapter 5: https://www.youtube.com/watch?v=wjZofJX0v4M
      • Chapter 6 recommends material by Andrej Karpathy, https://www.youtube.com/@AndrejKarpathy/videos for learning more.
      • Chapter 6 recommends material by Chris Olah, https://www.youtube.com/results?search_query=chris+olah
      • Chapter 6 recommended https://www.youtube.com/c/VCubingX for relevant material, in particular https://www.youtube.com/watch?v=1il-s4mgNdI
      • Chapter 6 recommended Art of the Problem, in particular https://www.youtube.com/watch?v=OFS90-FX6pg 
      • DD suggests as a reading, "Generative Agents: Interactive Simulacra of Human Behavior", https://arxiv.org/abs/2304.03442v1 (10/4/24).
      • LLMs and the singularity: https://philpapers.org/go.pl?id=ISHLLM&u=https%3A%2F%2Fphilpapers.org%2Farchive%2FISHLLM.pdf (summarized at: https://poe.com/s/WuYyhuciNwlFuSR0SVEt). 6/7/24: vote was 4 3/7. We read the abstract. We could start it any time. We could even spend some time on this and some time on something else in the same meeting.