Robustness of Bayesian Neural Networks to White Box Adversarial Attacks. Bayesian Neural Networks (BNNs), unlike Traditional Neural Networks (TNNs) are robust and adept at handling adversarial attacks by incorporating randomness. This randomness improves the estimation of uncertainty, a feature lacking in TNNs. Thus, we investigate the robustness of BNNs to white box attacks using multiple Bayesian neural architectures. Furthermore, we create our BNN model, called BNN DenseNet, by fusing Bayesian inference (i.e., variational Bayes) to the DenseNet architecture, and BDAV, by combining this intervention with adversarial training. Experiments are conducted on the CIFAR 10 and FGVC Aircraft datasets. We attack our models with strong white box attacks ( l infty FGSM, l infty PGD, l 2 PGD, EOT l infty FGSM, and EOT l infty PGD). In all experiments, at least one BNN outperforms traditional neural networks during adversarial attack scenarios. An adversarially trained BNN outperforms its non Bayesian, adversarially trained counterpart in most experiments, and often by significant margins. Lastly, we investigate network calibration and find that BNNs do not make overconfident predictions, providing evidence that BNNs are also better at measuring uncertainty.


A Vision based Irregular Obstacle Avoidance Framework via Deep Reinforcement Learning. Deep reinforcement learning has achieved great success in laser based collision avoidance work because the laser can sense accurate depth information without too much redundant data, which can maintain the robustness of the algorithm when it is migrated from the simulation environment to the real world. However, high cost laser devices are not only difficult to apply on a large scale but also have poor robustness to irregular objects, e.g., tables, chairs, shelves, etc. In this paper, we propose a vision based collision avoidance framework to solve the challenging problem. Our method attempts to estimate the depth and incorporate the semantic information from RGB data to obtain a new form of data, pseudo laser data, which combines the advantages of visual information and laser information. Compared to traditional laser data that only contains the one dimensional distance information captured at a certain height, our proposed pseudo laser data encodes the depth information and semantic information within the image, which makes our method more effective for irregular obstacles. Besides, we adaptively add noise to the laser data during the training stage to increase the robustness of our model in the real world, due to the estimated depth information is not accurate. Experimental results show that our framework achieves state of the art performance in several unseen virtual and real world scenarios.


Trading Transforms of Non weighted Simple Games and Integer Weights of Weighted Simple Games. This study investigates simple games. A fundamental research question in this field is to determine necessary and sufficient conditions for a simple game to be a weighted majority game. Taylor and Zwicker (1992) showed that a simple game is non weighted if and only if there exists a trading transform of finite size. They also provided an upper bound on the size of such a trading transform, if it exists. Gvozdeva and Slinko (2011) improved that upper bound their proof employed a property of linear inequalities demonstrated by Muroga (1971).In this study, we provide a new proof of the existence of a trading transform when a given simple game is non weighted. Our proof employs Farkas' lemma (1894), and yields an improved upper bound on the size of a trading transform. We also discuss an integer weight representation of a weighted simple game, improving the bounds obtained by Muroga (1971). We show that our bound on the quota is tight when the number of players is less than or equal to five, based on the computational results obtained by Kurz (2012). Furthermore, we discuss the problem of finding an integer weight representation under the assumption that we have minimal winning coalitions and maximal losing coalitions.In particular, we show a performance of a rounding method. Lastly, we address roughly weighted simple games. Gvozdeva and Slinko (2011) showed that a given simple game is not roughly weighted if and only if there exists a potent certificate of non weightedness. We give an upper bound on the length of a potent certificate of non weightedness. We also discuss an integer weight representation of a roughly weighted simple game.


Self Supervised Learning via multi Transformation Classification for Action Recognition. Self supervised tasks have been utilized to build useful representations that can be used in downstream tasks when the annotation is unavailable. In this paper, we introduce a self supervised video representation learning method based on the multi transformation classification to efficiently classify human actions. Self supervised learning on various transformations not only provides richer contextual information but also enables the visual representation more robust to the transforms. The spatio temporal representation of the video is learned in a self supervised manner by classifying seven different transformations i.e. rotation, clip inversion, permutation, split, join transformation, color switch, frame replacement, noise addition. First, seven different video transformations are applied to video clips. Then the 3D convolutional neural networks are utilized to extract features for clips and these features are processed to classify the pseudo labels. We use the learned models in pretext tasks as the pre trained models and fine tune them to recognize human actions in the downstream task. We have conducted the experiments on UCF101 and HMDB51 datasets together with C3D and 3D Resnet 18 as backbone networks. The experimental results have shown that our proposed framework is outperformed other SOTA self supervised action recognition approaches. The code will be made publicly available.


Some Notions of (Open) Dynamical System on Polynomial Interfaces. We define indexed categories of (open) dynamical system and random dynamical system over polynomial interfaces, where time is given by an arbitrary monoid mathbb T . We consider the case of open random dynamical systems over both open and closed noise sources, and the case where the interface of the random system is nested' over the interface of its noise source. We show that, in discrete time, our categories of dynamical systems over polynomial interfaces p are equivalent to Spivak's categories p mathbf Coalg of p coalgebras. We then define a notion of generalized pT coalgebra for a monad T , thereby extending the coalgebraic notion of dynamical system to general time, and show that this construction bestows a notion of open Markov process when the monad T is a probability monad. Finally, we list some further connections and open questions.


Notes on pivot pairings. We present a row reduction algorithm to compute the barcode decomposition of persistence modules. This algorithm dualises the standard persistence one and clarifies the symmetry between clear and compress optimisations.


Fixed Time Cooperative Behavioral Control for Networked Autonomous Agents with Second Order Nonlinear Dynamics. In this paper, we investigate the fixed time behavioral control problem for a team of second order nonlinear agents, aiming to achieve a desired formation with collision obstacle avoidance. In the proposed approach, the two behaviors(tasks) for each agent are prioritized and integrated via the framework of the null space based behavioral projection, leading to a desired merged velocity that guarantees the fixed time convergence of task errors. To track this desired velocity, we design a fixed time sliding mode controller for each agent with state independent adaptive gains, which provides a fixed time convergence of the tracking error. The control scheme is implemented in a distributed manner, where each agent only acquires information from its neighbors in the network. Moreover, we adopt an online learning algorithm to improve the robustness of the closed system with respect to uncertainties disturbances. Finally, simulation results are provided to show the effectiveness of the proposed approach.


Projective models of Nikulin orbifolds. We study projective fourfolds of K3 2 type with a symplectic involution and the deformations of their quotients, called orbifolds of Nikulin types they are IHS orbifolds. We compute the Riemann Roch formula for Weil divisors on such orbifolds and describe the first complete family of orbifolds of Nikulin type with a polarization of degree 2 as double covers of special complete intersections (3,4) in mathbb P 6 .


Double Rim Hook Cluster Algebras. We describe an infinite family of non Pl "ucker cluster variables inside the double Bruhat cell cluster algebra defined by Berenstein, Fomin, and Zelevinsky. These cluster variables occur in a family of subalgebras of the double Bruhat cell cluster algebra which we call Double Rim Hook (DRH) cluster algebras. We discover that all of the cluster variables are determinants of matrices of special form. We conjecture that all the cluster variables of the double Bruhat cell cluster algebra have similar determinant form. We notice the resemblance between our staircase diagram and Auslander Reiten quivers.


CLIP Forge Towards Zero Shot Text to Shape Generation. Generating shapes using natural language can enable new ways of imagining and creating the things around us. While significant recent progress has been made in text to image generation, text to shape generation remains a challenging problem due to the unavailability of paired text and shape data at a large scale. We present a simple yet effective method for zero shot text to shape generation that circumvents such data scarcity. Our proposed method, named CLIP Forge, is based on a two stage training process, which only depends on an unlabelled shape dataset and a pre trained image text network such as CLIP. Our method has the benefits of avoiding expensive inference time optimization, as well as the ability to generate multiple shapes for a given text. We not only demonstrate promising zero shot generalization of the CLIP Forge model qualitatively and quantitatively, but also provide extensive comparative evaluations to better understand its behavior.


Correcting Arabic Soft Spelling Mistakes using BiLSTM based Machine Learning. Soft spelling errors are a class of spelling mistakes that is widespread among native Arabic speakers and foreign learners alike. Some of these errors are typographical in nature. They occur due to orthographic variations of some Arabic letters and the complex rules that dictate their correct usage. Many people forgo these rules, and given the identical phonetic sounds, they often confuse such letters. In this paper, we propose a bidirectional long short term memory network that corrects this class of errors. We develop, train, evaluate, and compare a set of BiLSTM networks. We approach the spelling correction problem at the character level. We handle Arabic texts from both classical and modern standard Arabic. We treat the problem as a one to one sequence transcription problem. Since the soft Arabic errors class encompasses omission and addition mistakes, to preserve the one to one sequence transcription, we propose a simple low resource yet effective technique that maintains the one to one sequencing and avoids using a costly encoder decoder architecture. We train the BiLSTM models to correct the spelling mistakes using transformed input and stochastic error injection approaches. We recommend a configuration that has two BiLSTM layers, uses the dropout regularization, and is trained using the latter training approach with error injection rate of 40 . The best model corrects 96.4 of the injected errors and achieves a low character error rate of 1.28 on a real test set of soft spelling mistakes.


Singularities of solutions of Hamilton Jacobi equations. This is a survey paper on the quantitative analysis of the propagation of singularities for the viscosity solutions to Hamilton Jacobi equations in the past decades. We also review further applications of the theory to various fields such as Riemannian geometry, Hamiltonian dynamical systems and partial differential equations.


Implicit Bias of SGD for Diagonal Linear Networks a Provable Benefit of Stochasticity. Understanding the implicit bias of training algorithms is of crucial importance in order to explain the success of overparametrised neural networks. In this paper, we study the dynamics of stochastic gradient descent over diagonal linear networks through its continuous time version, namely stochastic gradient flow. We explicitly characterise the solution chosen by the stochastic flow and prove that it always enjoys better generalisation properties than that of gradient flow. Quite surprisingly, we show that the convergence speed of the training loss controls the magnitude of the biasing effect the slower the convergence, the better the bias. To fully complete our analysis, we provide convergence guarantees for the dynamics. We also give experimental results which support our theoretical claims. Our findings highlight the fact that structured noise can induce better generalisation and they help explain the greater performances observed in practice of stochastic gradient descent over gradient descent.


Adaptive Bitrate Streaming Over Cellular Networks Rate Adaptation and Data Savings Strategies. Adaptive bitrate streaming (ABR) has become thede factotechnique for videostreaming over the Internet. Despite a flurry of techniques, achieving high quality ABRstreaming over cellular networks remains a tremendous challenge. First, the design ofan ABR scheme needs to balance conflicting Quality of Experience (QoE) metrics suchas video quality, quality changes, stalls and startup performance, which is even harderunder highly dynamic bandwidth in cellular network. Second, streaming providers havebeen moving towards using Variable Bitrate (VBR) encodings for the video content,which introduces new challenges for ABR streaming, whose nature and implicationsare little understood. Third, mobile video streaming consumes a lot of data. Althoughmany video and network providers currently offer data saving options, the existingpractices are suboptimal in QoE and resource usage. Last, when the audio and videotracks are stored separately, video and audio rate adaptation needs to be dynamicallycoordinated to achieve good overall streaming experience, which presents interestingchallenges while, somewhat surprisingly, has received little attention by the researchcommunity. In this dissertation, we tackle each of the above four challenges.


Using Graph Neural Networks to model the performance of Deep Neural Networks. With the unprecedented proliferation of machine learning software, there is an ever increasing need to generate efficient code for such applications. State of the art deep learning compilers like TVM and Halide incorporate a learning based performance model to search the space of valid implementations of a given deep learning algorithm. For a given application, the model generates a performance metric such as the run time without executing the application on hardware. Such models speed up the compilation process by obviating the need to benchmark an enormous number of candidate implementations, referred to as schedules, on hardware. Existing performance models employ feed forward networks, recurrent networks, or decision tree ensembles to estimate the performance of different implementations of a neural network. Graphs present a natural and intuitive way to model deep learning networks where each node represents a computational stage or operation. Incorporating the inherent graph structure of these workloads in the performance model can enable a better representation and learning of inter stage interactions. The accuracy of a performance model has direct implications on the efficiency of the search strategy, making it a crucial component of this class of deep learning compilers. In this work, we develop a novel performance model that adopts a graph representation. In our model, each stage of computation represents a node characterized by features that capture the operations performed by the stage. The interaction between nodes is achieved using graph convolutions. Experimental evaluation shows a 7 75x and 12x reduction in prediction error compared to the Halide and TVM models, respectively.


Direct simple computation of middle surface between 3D point clouds and or discrete surfaces by tracking sources in distance function calculation algorithms. In this paper, we introduce novel methods for computing middle surfaces between various 3D data sets such as point clouds and or discrete surfaces. Traditionally the middle surface is obtained by detecting singularities in computed distance function such as ridges, triple junctions, etc. It requires to compute second order differential characteristics and also some kinds of heuristics must be applied. Opposite to that, we determine the middle surface just from computing the distance function itself which is a fast and simple approach. We present and compare the results of the fast sweeping method, the vector distance transform algorithm, the fast marching method, and the Dijkstra Pythagoras method in finding the middle surface between 3D data sets.


Certain residual properties of HNN extensions with central associated subgroups. Suppose that G is a group, H and K are proper isomorphic central subgroups of G , and mathfrak G is an HNN extension of G with the associated subgroups H and K . We prove necessary and sufficient conditions for mathfrak G to be residually a mathcal C group, where mathcal C is a class of groups closed under taking subgroups, extensions, homomorphic images, and Cartesian products of the form prod y in Y X y , where X, Y in mathcal C and X y is an isomorphic copy of X for each y in Y .


Clustering Market Regimes using the Wasserstein Distance. The problem of rapid and automated detection of distinct market regimes is a topic of great interest to financial mathematicians and practitioners alike. In this paper, we outline an unsupervised learning algorithm for clustering financial time series into a suitable number of temporal segments (market regimes). As a special case of the above, we develop a robust algorithm that automates the process of classifying market regimes. The method is robust in the sense that it does not depend on modelling assumptions of the underlying time series as our experiments with real datasets show. This method dubbed the Wasserstein k means algorithm frames such a problem as one on the space of probability measures with finite p text th moment, in terms of the p Wasserstein distance between (empirical) distributions. We compare our WK means approach with a more traditional clustering algorithms by studying the so called maximum mean discrepancy scores between, and within clusters. In both cases it is shown that the WK means algorithm vastly outperforms all considered competitor approaches. We demonstrate the performance of all approaches both in a controlled environment on synthetic data, and on real data.


Developing a Trusted Human AI Network for Humanitarian Benefit. Humans and artificial intelligences (AI) will increasingly participate digitally and physically in conflicts, yet there is a lack of trusted communications across agents and platforms. For example, humans in disasters and conflict already use messaging and social media to share information, however, international humanitarian relief organisations treat this information as unverifiable and untrustworthy. AI may reduce the 'fog of war' and improve outcomes, however AI implementations are often brittle, have a narrow scope of application and wide ethical risks. Meanwhile, human error causes significant civilian harms even by combatants committed to complying with international humanitarian law. AI offers an opportunity to help reduce the tragedy of war and deliver humanitarian aid to those who need it. In this paper we consider the integration of a communications protocol (the 'Whiteflag protocol'), distributed ledger technology, and information fusion with artificial intelligence (AI), to improve conflict communications called 'Protected Assurance Understanding Situation and Entities' (PAUSE). Such a trusted human AI communication network could provide accountable information exchange regarding protected entities, critical infrastructure humanitarian signals and status updates for humans and machines in conflicts.


Certified Adversarial Defenses Meet Out of Distribution Corruptions Benchmarking Robustness and Simple Baselines. Certified robustness guarantee gauges a model's robustness to test time attacks and can assess the model's readiness for deployment in the real world. In this work, we critically examine how the adversarial robustness guarantees from randomized smoothing based certification methods change when state of the art certifiably robust models encounter out of distribution (OOD) data. Our analysis demonstrates a previously unknown vulnerability of these models to low frequency OOD data such as weather related corruptions, rendering these models unfit for deployment in the wild. To alleviate this issue, we propose a novel data augmentation scheme, FourierMix, that produces augmentations to improve the spectral coverage of the training data. Furthermore, we propose a new regularizer that encourages consistent predictions on noise perturbations of the augmented data to improve the quality of the smoothed models. We find that FourierMix augmentations help eliminate the spectral bias of certifiably robust models enabling them to achieve significantly better robustness guarantees on a range of OOD benchmarks. Our evaluation also uncovers the inability of current OOD benchmarks at highlighting the spectral biases of the models. To this end, we propose a comprehensive benchmarking suite that contains corruptions from different regions in the spectral domain. Evaluation of models trained with popular augmentation methods on the proposed suite highlights their spectral biases and establishes the superiority of FourierMix trained models at achieving better certified robustness guarantees under OOD shifts over the entire frequency spectrum.


Importance Weighted Adversarial Discriminative Transfer for Anomaly Detection. Previous transfer methods for anomaly detection generally assume the availability of labeled data in source or target domains. However, such an assumption is not valid in most real applications where large scale labeled data are too expensive. Therefore, this paper proposes an importance weighted adversarial autoencoder based method to transfer anomaly detection knowledge in an unsupervised manner, particularly for a rarely studied scenario where a target domain has no labeled normal abnormal data while only normal data from a related source domain exist. Specifically, the method learns to align the distributions of normal data in both source and target domains, but leave the distribution of abnormal data in the target domain unchanged. In this way, an obvious gap can be produced between the distributions of normal and abnormal data in the target domain, therefore enabling the anomaly detection in the domain. Extensive experiments on multiple synthetic datasets and the UCSD benchmark demonstrate the effectiveness of our approach.


SphereFace Revived Unifying Hyperspherical Face Recognition. This paper addresses the deep face recognition problem under an open set protocol, where ideal face features are expected to have smaller maximal intra class distance than minimal inter class distance under a suitably chosen metric space. To this end, hyperspherical face recognition, as a promising line of research, has attracted increasing attention and gradually become a major focus in face recognition research. As one of the earliest works in hyperspherical face recognition, SphereFace explicitly proposed to learn face embeddings with large inter class angular margin. However, SphereFace still suffers from severe training instability which limits its application in practice. In order to address this problem, we introduce a unified framework to understand large angular margin in hyperspherical face recognition. Under this framework, we extend the study of SphereFace and propose an improved variant with substantially better training stability SphereFace R. Specifically, we propose two novel ways to implement the multiplicative margin, and study SphereFace R under three different feature normalization schemes (no feature normalization, hard feature normalization and soft feature normalization). We also propose an implementation strategy "characteristic gradient detachment" to stabilize training. Extensive experiments on SphereFace R show that it is consistently better than or competitive with state of the art methods.


Human agent coordination in a group formation game. Coordination and cooperation between humans and autonomous agents in cooperative games raises interesting questions of human decision making and behaviour changes. Here we report our findings from a group formation game in a small world network of different mixes of human and agent players, aiming to achieve connected clusters of the same colour by swapping places with neighbouring players using non overlapping information. In the experiments the human players are incentivized by rewarding to prioritize their own cluster while the model of agents' decision making is derived from our previous experiment of purely cooperative game between human players. The experiments were performed by grouping the players in three different setups to investigate the overall effect of having cooperative autonomous agents within teams. We observe that the change in the behavior of human subjects adjusts to playing with autonomous agents by being less risk averse, while keeping the overall performance efficient by splitting the behaviour into selfish and cooperative in the two actions performed during the rounds of the game. Moreover, results from two hybrid human agent setups suggest that the group composition affects the evolution of clusters. Our findings indicate that in purely or lesser cooperative settings, providing more control to humans could help in maximizing the overall performance of hybrid systems.


Generation of ultra relativistic monoenergetic electron bunches via a synergistic interaction of longitudinal electric and magnetic fields of a twisted laser. We use 3D simulations to demonstrate that high quality ultra relativistic electron bunches can be generated upon reflection of a twisted laser beam off a plasma mirror. The unique topology of the beam with a twist index l 1 creates an accelerating structure dominated by longitudinal laser electric and magnetic fields in the near axis region. We show that the magnetic field is essential for creating a train of dense mono energetic bunches. For a 6.8 PW laser, the energy reaches 1.6 GeV with a spread of 5.5 . The bunch duration is 320 as, its charge is 60 pC and density is sim 10 27 m 3 . The results are confirmed by an analytical model for the electron energy gain. These results enable development of novel laser driven accelerators at multi PW laser facilities.


DEUS A Data driven Approach to Estimate User Satisfaction in Multi turn Dialogues. Digital assistants are experiencing rapid growth due to their ability to assist users with day to day tasks where most dialogues are happening multi turn. However, evaluating multi turn dialogues remains challenging, especially at scale. We suggest a context sensitive method to estimate the turn level satisfaction for dialogue considering various types of user preferences. The costs of interactions between users and dialogue systems are formulated using a budget consumption concept. We assume users have an initial interaction budget for a dialogue formed based on the task complexity and that each turn has a cost. When the task is completed, or the budget has been exhausted, users quit the dialogue. We demonstrate our method's effectiveness by extensive experimentation with a simulated dialogue platform and real multi turn dialogues.


Keyphrase Generation Beyond the Boundaries of Title and Abstract. Keyphrase generation aims at generating phrases (keyphrases) that best describe a given document. In scholarly domains, current approaches to this task are neural approaches and have largely worked with only the title and abstract of the articles. In this work, we explore whether the integration of additional data from semantically similar articles or from the full text of the given article can be helpful for a neural keyphrase generation model. We discover that adding sentences from the full text particularly in the form of summary of the article can significantly improve the generation of both types of keyphrases that are either present or absent from the title and abstract. The experimental results on the three acclaimed models along with one of the latest transformer models suitable for longer documents, Longformer Encoder Decoder (LED) validate the observation. We also present a new large scale scholarly dataset FullTextKP for keyphrase generation, which we use for our experiments. Unlike prior large scale datasets, FullTextKP includes the full text of the articles alongside title and abstract. We will release the source code to stimulate research on the proposed ideas.


A speed preserving Hilbert gradient flow for generalized integral Menger curvature. We establish long time existence for a projected Sobolev gradient flow of generalized integral Menger curvature in the Hilbert case, and provide C 1,1 bounds in time for the solution that only depend on the initial curve. The self avoidance property of integral Menger curvature guarantees that the knot class of the initial curve is preserved under the flow, and the projection ensures that each curve along the flow is parametrized with the same speed as the initial configuration. Finally, we describe how to simulate this flow numerically with substantially higher efficiency than in the corresponding numerical L 2 gradient descent or other optimization methods.


Safe Fakes Evaluating Face Anonymizers for Face Detectors. Since the introduction of the GDPR and CCPA legislation, both public and private facial image datasets are increasingly scrutinized. Several datasets have been taken offline completely and some have been anonymized. However, it is unclear how anonymization impacts face detection performance. To our knowledge, this paper presents the first empirical study on the effect of image anonymization on supervised training of face detectors. We compare conventional face anonymizers with three state of the art Generative Adversarial Network based (GAN) methods, by training an off the shelf face detector on anonymized data. Our experiments investigate the suitability of anonymization methods for maintaining face detector performance, the effect of detectors overtraining on anonymization artefacts, dataset size for training an anonymizer, and the effect of training time of anonymization GANs. A final experiment investigates the correlation between common GAN evaluation metrics and the performance of a trained face detector. Although all tested anonymization methods lower the performance of trained face detectors, faces anonymized using GANs cause far smaller performance degradation than conventional methods. As the most important finding, the best performing GAN, DeepPrivacy, removes identifiable faces for a face detector trained on anonymized data, resulting in a modest decrease from 91.0 to 88.3 mAP. In the last few years, there have been rapid improvements in realism of GAN generated faces. We expect that further progression in GAN research will allow the use of Deep Fake technology for privacy preserving Safe Fakes, without any performance degradation for training face detectors.


SIS Epidemic Model Birth and Death Markov Chain Approach. We are interested in describing the infected size of the SIS Epidemic model using Birth Death Markov process. The Susceptible Infected Susceptible (SIS) model is defined within a population of constant size M the size is kept constant by replacing each death with a newborn healthy individual. The life span of each individual in the population is modelled by an exponential distribution with parameter alpha and the disease spreads within the population is modelled by a Poisson process with a rate lambda I . lambda I beta I(1 frac I M ) is similar to the instantaneous rate in the logistic population growth model. The analysis is focused on the disease outbreak, where the reproduction number R frac beta alpha is greater than one. As methodology, we use both numerical and analytical approaches. The analysis relies on the stationary distribution for Birth and Death Markov process. The numerical approach creates sample path simulations into order show the infected size dynamics, and the relationship between infected size and R . As M becomes large, some stable statistical characteristics of the infected size distribution can be deduced. And the infected size is shown analytically to follow a normal distribution with mean (1 frac 1 R ) M and Variance frac M R .


Performance Evaluation of Ad Hoc Multicast Routing Protocols to Facilitate Video Streaming in VANETS. Vehicular Ad Hoc Network (VANET) is a type of mobile ad hoc network (MANET) that facilitates communication among vehicles. VANET provides inter vehicular communications to serve for the application like road traffic safety and traffic efficiency. Infotainment service has been an anticipating trend in VANETs, and video streaming has a high potential in VANET. Although, this emerging technology is trending, there are still some issues like QoS provisions, decentralized medium access control, node coverage area, and finding and maintaining routes due to highly dynamic topology. These issues make multicast communication difficult in VANETs. Numerous routing protocols and routing strategies have been projected to cope with these issues. Lots of work has taken place to assess and measure the performances of these protocols in VANETs but these protocols are rarely analyzed for performance under stress of real time video multicast. In this study two different multicast routing protocols viz. Multicast Ad hoc On Demand Distance Vector (MAODV) and Protocol for Unified Multicasting through Announcements (PUMA) are evaluated for facilitating video streaming in VANETS. The protocols are examined against the QoS parameters such as Network Throughput, Packet Delivery Ratio (PDR), Average end to end Delay, and Normalized Routing Load (NRL). Variable Bit Rate (VBR) traffic is used to evaluate the performances of protocol. PUMA, at the end, showed better performance against different QoS provisions in different scenarios


Improving Multimodal Fusion with Hierarchical Mutual Information Maximization for Multimodal Sentiment Analysis. In multimodal sentiment analysis (MSA), the performance of a model highly depends on the quality of synthesized embeddings. These embeddings are generated from the upstream process called multimodal fusion, which aims to extract and combine the input unimodal raw data to produce a richer multimodal representation. Previous work either back propagates the task loss or manipulates the geometric property of feature spaces to produce favorable fusion results, which neglects the preservation of critical task related information that flows from input to the fusion results. In this work, we propose a framework named MultiModal InfoMax (MMIM), which hierarchically maximizes the Mutual Information (MI) in unimodal input pairs (inter modality) and between multimodal fusion result and unimodal input in order to maintain task related information through multimodal fusion. The framework is jointly trained with the main task (MSA) to improve the performance of the downstream MSA task. To address the intractable issue of MI bounds, we further formulate a set of computationally simple parametric and non parametric methods to approximate their truth value. Experimental results on the two widely used datasets demonstrate the efficacy of our approach. The implementation of this work is publicly available at https github.com declare lab Multimodal Infomax.


A proof of the Extended Delta Conjecture. We prove the Extended Delta Conjecture of Haglund, Remmel, and Wilson, a combinatorial formula for Delta h l Delta' e k e n , where Delta' e k and Delta h l are Macdonald eigenoperators and e n is an elementary symmetric function. We actually prove a stronger identity of infinite series of GL m characters expressed in terms of LLT series. This is achieved through new results in the theory of the Schiffmann algebra and its action on the algebra of symmetric functions.


Neutral Helium Microscopy (SHeM) A Review. Neutral helium microscopy, also referred to as scanning helium atom microscopy and commonly abbreviated SHeM, is a novel imaging technique that uses a beam of neutral helium atoms as an imaging probe. The technique offers a number of advantages such as the very low energy of the incident probing atoms (less than 0.1 eV), unsurpassed surface sensitivity (no penetration into the sample bulk), a charge neutral, inert probe and a high depth of field. This means that fragile and or non conducting samples can be imaged as well as samples with high aspect ratio, with the potential to obtain true to scale height information of 3D surface topography with nanometer resolution. However, for a full exploitation of the technique, a range of experimental and theoretical issues still needs to be resolved. In this paper we review the current state of research in the field. We do this by following the trajectory of the helium atoms step by step through the microscope. From the initial acceleration in the supersonic expansion used to generate the probing beam over the interaction of the helium atoms with the sample (contrast properties) to the final detection and post processing. We also review recent advances in scanning helium microscope design and we present an overview of the samples that have been investigated with SHeM up till now.


Towards Long term Fairness in Recommendation. As Recommender Systems (RS) influence more and more people in their daily life, the issue of fairness in recommendation is becoming more and more important. Most of the prior approaches to fairness aware recommendation have been situated in a static or one shot setting, where the protected groups of items are fixed, and the model provides a one time fairness solution based on fairness constrained optimization. This fails to consider the dynamic nature of the recommender systems, where attributes such as item popularity may change over time due to the recommendation policy and user engagement. For example, products that were once popular may become no longer popular, and vice versa. As a result, the system that aims to maintain long term fairness on the item exposure in different popularity groups must accommodate this change in a timely fashion. Novel to this work, we explore the problem of long term fairness in recommendation and accomplish the problem through dynamic fairness learning. We focus on the fairness of exposure of items in different groups, while the division of the groups is based on item popularity, which dynamically changes over time in the recommendation process. We tackle this problem by proposing a fairness constrained reinforcement learning algorithm for recommendation, which models the recommendation problem as a Constrained Markov Decision Process (CMDP), so that the model can dynamically adjust its recommendation policy to make sure the fairness requirement is always satisfied when the environment changes. Experiments on several real world datasets verify our framework's superiority in terms of recommendation performance, short term fairness, and long term fairness.


Lyapunov optimizing measures and periodic measures for C 2 expanding maps. We prove that there exists an open and dense subset mathcal U in the space of C 2 expanding self maps of the circle mathbb T such that the Lyapunov minimizing measures of any T in mathcal U are uniquely supported on a periodic orbit.This answers a conjecture of Jenkinson Morris in the C 2 topology.


vlang Mapping Verilog Netlists to Modern Technologies. Portability of hardware designs between Programmable Logic Devices (PLD) can be accomplished through the use of device agnostic hardware description languages (HDL) such as Verilog or VHDL. Hardware designers can use HDLs to migrate hardware designs between devices and explore performance, area and power tradeoffs, as well as, port designs to an alternative device. However, if design files are corrupt or missing, the portability of the design is lost. While reverse engineering efforts may be able to recover an HDL netlist of the original design, HDL netlists use device specific primitives, restricting portability. Additionally, the recovered design may benefit from other computational technologies (e.g., mu P, GPGPUs), but is restricted to the domain of PLDs. In this work, we provide a new framework, vlang, which automatically maps Verilog netlists into LLVM's intermediate representation (IR). The remapped design can use the LLVM framework to target many device technologies such as x86 64 assembly, RISC V, ARM or to other PLDs with a modern high level synthesis tool. Our framework is able to preserve the exact functionality of the original design within the software executable. The vlang produced software executable can be used with other software programs, or to verify the functionality and correctness of the remapped design. We evaluate our work with a suite of hardware designs from OpenCores. We compare our framework against state of the art simulators, thereby outlining our framework's ability to produce a fully functional, cycle accurate software executable. We also explore the usage of vlang as a front end for high level synthesis tools.


cs.CE cs.AI cs.NA math.NA physics.flu-dyn

Stacked Generative Machine Learning Models for Fast Approximations of Steady State Navier Stokes Equations. Computational fluid dynamics (CFD) simulations are broadly applied in engineering and physics. A standard description of fluid dynamics requires solving the Navier Stokes (N S) equations in different flow regimes. However, applications of CFD simulations are computationally limited by the availability, speed, and parallelism of high performance computing. To improve computational efficiency, machine learning techniques have been used to create accelerated data driven approximations for CFD. A majority of such approaches rely on large labeled CFD datasets that are expensive to obtain at the scale necessary to build robust data driven models. We develop a weakly supervised approach to solve the steady state N S equations under various boundary conditions, using a multi channel input with boundary and geometric conditions. We achieve state of the art results without any labeled simulation data, but using a custom data driven and physics informed loss function by using and small scale solutions to prime the model to solve the N S equations. To improve the resolution and predictability, we train stacked models of increasing complexity generating the numerical solutions for N S equations. Without expensive computations, our model achieves high predictability with a variety of obstacles and boundary conditions. Given its high flexibility, the model can generate a solution on a 64 x 64 domain within 5 ms on a regular desktop computer which is 1000 times faster than a regular CFD solver. Translation of interactive CFD simulation on local consumer computing hardware enables new applications in real time predictions on the internet of things devices where data transfer is prohibitive and can increase the scale, speed, and computational cost of boundary value fluid problems.


Functional Equations Associated to Collatz Type Maps on Integer Rings of Algebraic Number Fields. In 1995, Meinardus Berg presented a reformulation of the Collatz Conjecture in terms of a functional equation in a single complex variable over the open unit disk. This paper generalizes that method to deal with not only a large class of Collatz type maps defined on the integers, but further generalizations thereof to Collatz type maps on the rings of integers on an arbitrary algebraic number field.


Impact of the COVID 19 outbreak on Italy's country reputation and stock market performance a sentiment analysis approach. During the recent Coronavirus disease 2019 (COVID 19) outbreak, the microblogging service Twitter has been widely used to share opinions and reactions to events. Italy was one of the first European countries to be severely affected by the outbreak and to establish lockdown and stay at home orders, potentially leading to country reputation damage. We resort to sentiment analysis to investigate changes in opinions about Italy reported on Twitter before and after the COVID 19 outbreak. Using different lexicons based methods, we find a breakpoint corresponding to the date of the first established case of COVID 19 in Italy that causes a relevant change in sentiment scores used as proxy of the country reputation. Next, we demonstrate that sentiment scores about Italy are strongly associated with the levels of the FTSE MIB index, the Italian Stock Exchange main index, as they serve as early detection signals of changes in the values of FTSE MIB. Finally, we make a content based classification of tweets into positive and negative and use two machine learning classifiers to validate the assigned polarity of tweets posted before and after the outbreak.


Designing for Engaging with News using Moral Framing towards Bridging Ideological Divides. Society is showing signs of strong ideological polarization. When pushed to seek perspectives different from their own, people often reject diverse ideas or find them unfathomable. Work has shown that framing controversial issues using the values of the audience can improve understanding of opposing views. In this paper, we present our work designing systems for addressing ideological division through educating U.S. news consumers to engage using a framework of fundamental human values known as Moral Foundations. We design and implement a series of new features that encourage users to challenge their understanding of opposing views, including annotation of moral frames in news articles, discussion of those frames via inline comments, and recommendations based on relevant moral frames. We describe two versions of features the first covering a suite of ways to interact with moral framing in news, and the second tailored towards collaborative annotation and discussion. We conduct a field evaluation of each design iteration with 71 participants in total over a period of 6 8 days, finding evidence suggesting users learned to re frame their discourse in moral values of the opposing side. Our work provides several design considerations for building systems to engage with moral framing.


Scaling Scientometrics Dimensions on Google BigQuery as an infrastructure for large scale analysis. Cloud computing has the capacity to transform many parts of the research ecosystem, from particular research areas to overall strategic decision making and policy. Scientometrics sits at the boundary between research and the decision making and evaluation processes of research. One of the biggest challenges in research policy and strategy is having access to data that allows iterative analysis to inform decisions. Many of these decisions are based on "global" measures such as benchmark metrics that are hard to source. In this article, Cloud technologies are explored in this context. A novel visualisation technique is presented and used as a means to explore the potential for scaling scientometrics by democratising both access to data and compute capacity using the Cloud.


Federated Reconnaissance Efficient, Distributed, Class Incremental Learning. We describe federated reconnaissance, a class of learning problems in which distributed clients learn new concepts independently and communicate that knowledge efficiently. In particular, we propose an evaluation framework and methodological baseline for a system in which each client is expected to learn a growing set of classes and communicate knowledge of those classes efficiently with other clients, such that, after knowledge merging, the clients should be able to accurately discriminate between classes in the superset of classes observed by the set of clients. We compare a range of learning algorithms for this problem and find that prototypical networks are a strong approach in that they are robust to catastrophic forgetting while incorporating new information efficiently. Furthermore, we show that the online averaging of prototype vectors is effective for client model merging and requires only a small amount of communication overhead, memory, and update time per class with no gradient based learning or hyperparameter tuning. Additionally, to put our results in context, we find that a simple, prototypical network with four convolutional layers significantly outperforms complex, state of the art continual learning algorithms, increasing the accuracy by over 22 after learning 600 Omniglot classes and over 33 after learning 20 mini ImageNet classes incrementally. These results have important implications for federated reconnaissance and continual learning more generally by demonstrating that communicating feature vectors is an efficient, robust, and effective means for distributed, continual learning.


Localization, monoid sets and K theory. We develop the K theory of sets with an action of a pointed monoid (or monoid scheme), analogous to the K theory of modules over a ring (or scheme). In order to form localization sequences, we construct the quotient category of a nice regular category by a Serre subcategory.


Deep Reinforcement Learning with Function Properties in Mean Reversion Strategies. Over the past decades, researchers have been pushing the limits of Deep Reinforcement Learning (DRL). Although DRL has attracted substantial interest from practitioners, many are blocked by having to search through a plethora of available methodologies that are seemingly alike, while others are still building RL agents from scratch based on classical theories. To address the aforementioned gaps in adopting the latest DRL methods, I am particularly interested in testing out if any of the recent technology developed by the leads in the field can be readily applied to a class of optimal trading problems. Unsurprisingly, many prominent breakthroughs in DRL are investigated and tested on strategic games from AlphaGo to AlphaStar and at about the same time, OpenAI Five. Thus, in this writing, I want to show precisely how to use a DRL library that is initially built for games in a fundamental trading problem mean reversion. And by introducing a framework that incorporates economically motivated function properties, I also demonstrate, through the library, a highly performant and convergent DRL solution to decision making financial problems in general.


A cross diffusion system obtained via (convex) relaxation in the JKO scheme. In this paper, we start from a very natural system of cross diffusion equations which, unfortunately, is not well posed as it is the gradient flow for the Wasserstein distance of a functional which is not lower semi continuous due to lack of convexity of the integral. We then compute the convexification of the integral and prove existence of a solution in a suitable sense for the gradient flow of the corresponding relaxed functional. This gradient flow has also a cross diffusion structure but the mixture between two different regimes which are determined by the convexification makes this study non trivial.


Profinite infty operads. We show that a profinite completion functor for (simplicial or topological) operads with good homotopical properties can be constructed as a left Quillen functor from an appropriate model category of infinity operads to a certain model category of profinite infinity operads. The construction is based on a notion of lean infinity operad, and we characterize those infinity operads weakly equivalent to lean ones in terms of homotopical finiteness properties. Several variants of the construction are also discussed, such as the cases of unital (or closed) infinity operads and of infinity categories.


Multi Class Data Description for Out of distribution Detection. The capability of reliably detecting out of distribution samples is one of the key factors in deploying a good classifier, as the test distribution always does not match with the training distribution in most real world applications. In this work, we present a deep multi class data description, termed as Deep MCDD, which is effective to detect out of distribution (OOD) samples as well as classify in distribution (ID) samples. Unlike the softmax classifier that only focuses on the linear decision boundary partitioning its latent space into multiple regions, our Deep MCDD aims to find a spherical decision boundary for each class which determines whether a test sample belongs to the class or not. By integrating the concept of Gaussian discriminant analysis into deep neural networks, we propose a deep learning objective to learn class conditional distributions that are explicitly modeled as separable Gaussian distributions. Thereby, we can define the confidence score by the distance of a test sample from each class conditional distribution, and utilize it for identifying OOD samples. Our empirical evaluation on multi class tabular and image datasets demonstrates that Deep MCDD achieves the best performances in distinguishing OOD samples while showing the classification accuracy as high as the other competitors.


Gradient Masking and the Underestimated Robustness Threats of Differential Privacy in Deep Learning. An important problem in deep learning is the privacy and security of neural networks (NNs). Both aspects have long been considered separately. To date, it is still poorly understood how privacy enhancing training affects the robustness of NNs. This paper experimentally evaluates the impact of training with Differential Privacy (DP), a standard method for privacy preservation, on model vulnerability against a broad range of adversarial attacks. The results suggest that private models are less robust than their non private counterparts, and that adversarial examples transfer better among DP models than between non private and private ones. Furthermore, detailed analyses of DP and non DP models suggest significant differences between their gradients. Additionally, this work is the first to observe that an unfavorable choice of parameters in DP training can lead to gradient masking, and, thereby, results in a wrong sense of security.


Recent Ice Trends in Swiss Mountain Lakes 20 year Analysis of MODIS Imagery. Depleting lake ice can serve as an indicator for climate change, just like sea level rise or glacial retreat. Several Lake Ice Phenological (LIP) events serve as sentinels to understand the regional and global climate change. Hence, it is useful to monitor long term lake freezing and thawing patterns. In this paper we report a case study for the Oberengadin region of Switzerland, where there are several small and medium sized mountain lakes. We observe the LIP events, such as freeze up, break up and ice cover duration, across two decades (2000 2020) from optical satellite images. We analyse time series of MODIS imagery by estimating spatially resolved maps of lake ice for these Alpine lakes with supervised machine learning (and additionally cross check with VIIRS data when available). To train the classifier we rely on reference data annotated manually based on webcam images. From the ice maps we derive long term LIP trends. Since the webcam data is only available for two winters, we also validate our results against the operational MODIS and VIIRS snow products. We find a change in complete freeze duration of 0.76 and 0.89 days per annum for lakes Sils and Silvaplana, respectively. Furthermore, we observe plausible correlations of the LIP trends with climate data measured at nearby meteorological stations. We notice that mean winter air temperature has negative correlation with the freeze duration and break up events, and positive correlation with the freeze up events. Additionally, we observe strong negative correlation of sunshine during the winter months with the freeze duration and break up events.


Wheels A New Criterion for Non convexity of Neural Codes. We introduce new geometric and combinatorial criteria that preclude a neural code from being convex, and use them to tackle the classification problem for codes on six neurons. Along the way, we give the first example of a code that is non convex, has no local obstructions, and has simplicial complex of dimension two. We also characterize convexity for neural codes for which the simplicial complex is pure of low or high dimension.


Taxonomizing local versus global structure in neural network loss landscapes. Viewing neural network models in terms of their loss landscapes has a long history in the statistical mechanics approach to learning, and in recent years it has received attention within machine learning proper. Among other things, local metrics (such as the smoothness of the loss landscape) have been shown to correlate with global properties of the model (such as good generalization performance). Here, we perform a detailed empirical analysis of the loss landscape structure of thousands of neural network models, systematically varying learning tasks, model architectures, and or quantity quality of data. By considering a range of metrics that attempt to capture different aspects of the loss landscape, we demonstrate that the best test accuracy is obtained when the loss landscape is globally well connected ensembles of trained models are more similar to each other and models converge to locally smooth regions. We also show that globally poorly connected landscapes can arise when models are small or when they are trained to lower quality data and that, if the loss landscape is globally poorly connected, then training to zero loss can actually lead to worse test accuracy. Our detailed empirical results shed light on phases of learning (and consequent double descent behavior), fundamental versus incidental determinants of good generalization, the role of load like and temperature like parameters in the learning process, different influences on the loss landscape from model and data, and the relationships between local and global metrics, all topics of recent interest.


Multiplicative bounds for measures of irrationality on complete intersections. We show that measures of irrationality on very general codimension two complete intersections and very general complete intersection surfaces are multiplicative in the degrees of the defining equations. This confirms some cases of a conjecture of Bastianelli, De Poi, Ein, Lazarsfeld, and Ullery. Our methods involve studying the numerical invariants of curves on complete intersections.


Metagratings for Perfect Mode Conversion in Rectangular Waveguides Theory and Experiment. We present a complete design scheme, from theoretical formulation to experimental validation, exploiting the versatility of metagratings (MGs) for designing a rectangular waveguide (RWG) mbox TE 10 mbox TE 20 mode converter (MC). MG devices, formed by sparse periodically positioned polarizable particles (meta atoms), were mostly used to date for beam manipulation applications. In this paper, we show that the appealing diffraction engineering features of the MGs in such typical free space periodic scenarios can be utilized to efficiently mould fields inside waveguides (WGs). In particular, we derive an analytical model allowing harnessing of the MG concept for realization of perfect mode conversion in RWGs. Conveniently, the formalism considers a printed circuit board (PCB) MG terminating the RWG, operating as a reflect mode MC. Following the typical MG synthesis approach, the model directly ties the meta atom position and geometry with the modal reflection coefficients, enabling resolution of the detailed fabrication ready design by enforcement of the functionality constraints elimination of the fundamental mbox TE 10 reflection and power conservation (passive lossless MG). This reliable semianaltyical scheme, verified via full wave simulations and laboratory measurements, establishes a simple and efficient alternative to common RWG MCs, typically requiring challenging deformation of the WG designed through time consuming full wave optimization. In addition, it highlights the immense potential MGs encompass for a wide variety of applications beyond beam manipulation.


Stability of constant steady states of a chemotaxis model. The Cauchy problem for the parabolic elliptic Keller Segel system in the whole n dimensional space is studied. For this model, every constant A in mathbb R is a stationary solution. The main goal of this work is to show that A 1 is a stable steady state while A 1 is unstable. Uniformly local Lebesgue spaces are used in order to deal with solutions that do not decay at spatial variable on the unbounded domain.


Deep Human guided Conditional Variational Generative Modeling for Automated Urban Planning. Urban planning designs land use configurations and can benefit building livable, sustainable, safe communities. Inspired by image generation, deep urban planning aims to leverage deep learning to generate land use configurations. However, urban planning is a complex process. Existing studies usually ignore the need of personalized human guidance in planning, and spatial hierarchical structure in planning generation. Moreover, the lack of large scale land use configuration samples poses a data sparsity challenge. This paper studies a novel deep human guided urban planning method to jointly solve the above challenges. Specifically, we formulate the problem into a deep conditional variational autoencoder based framework. In this framework, we exploit the deep encoder decoder design to generate land use configurations. To capture the spatial hierarchy structure of land uses, we enforce the decoder to generate both the coarse grained layer of functional zones, and the fine grained layer of POI distributions. To integrate human guidance, we allow humans to describe what they need as texts and use these texts as a model condition input. To mitigate training data sparsity and improve model robustness, we introduce a variational Gaussian embedding mechanism. It not just allows us to better approximate the embedding space distribution of training data and sample a larger population to overcome sparsity, but also adds more probabilistic randomness into the urban planning generation to improve embedding diversity so as to improve robustness. Finally, we present extensive experiments to validate the enhanced performances of our method.


Attack as Defense Characterizing Adversarial Examples using Robustness. As a new programming paradigm, deep learning has expanded its application to many real world problems. At the same time, deep learning based software are found to be vulnerable to adversarial attacks. Though various defense mechanisms have been proposed to improve robustness of deep learning software, many of them are ineffective against adaptive attacks. In this work, we propose a novel characterization to distinguish adversarial examples from benign ones based on the observation that adversarial examples are significantly less robust than benign ones. As existing robustness measurement does not scale to large networks, we propose a novel defense framework, named attack as defense (A2D), to detect adversarial examples by effectively evaluating an example's robustness. A2D uses the cost of attacking an input for robustness evaluation and identifies those less robust examples as adversarial since less robust examples are easier to attack. Extensive experiment results on MNIST, CIFAR10 and ImageNet show that A2D is more effective than recent promising approaches. We also evaluate our defence against potential adaptive attacks and show that A2D is effective in defending carefully designed adaptive attacks, e.g., the attack success rate drops to 0 on CIFAR10.


Kinematic Control of compliant serial manipulators composed of dual triangles. The paper focuses on the kinematics control of a compliant serial manipulator composed of a new type of dualtriangle elastic segments. Some useful optimization techniques were applied to solve the geometric redundancy problem, ensure the stability of the manipulator configurations with respect to the external forces torques applied to the endeffector. The efficiency of the developed control algorisms is confirmed by simulation.


A representation theorem for end spaces of infinite graphs. End spaces of infinite graphs sit at the interface between graph theory, group theory and topology. They arise as the boundary of an infinite graph in a standard sense generalising the theory of the Freudenthal boundary developed by Freudenthal and Hopf in the 1940's for infinite groups. A long standing quest in infinite graph theory with a rich body of literature seeks to describe the possible end structures of graphs by a set of low complexity representatives. In this paper we present a solution to this fifty year old problem by showing that every end space is homeomorphic to the end space of some (uniform graph on a) special order tree.


Ultrafast circularly polarized pulses tunable from the vacuum to deep ultraviolet. We experimentally demonstrate the efficient generation of circularly polarized pulses tunable from the vacuum to deep ultraviolet (160 380 nm) through resonant dispersive wave emission from optical solitons in a gas filled hollow capillary fiber. In the deep ultraviolet we measure up to 13 microjoule of pulse energy, and from numerical simulations, we estimate the shortest output pulse duration to be 8.5 fs. We also experimentally verify that simply scaling the pulse energy by 3 2 between linearly and circularly polarized pumping closely reproduces the soliton and dispersive wave dynamics. Based on previous results with linearly polarized self compression and resonant dispersive wave emission, we expect our technique to be extended to produce circularly polarized few fs pulses further into the vacuum ultraviolet, and few to sub fs circularly polarized pulses in the near infrared.


GSECnet Ground Segmentation of Point Clouds for Edge Computing. Ground segmentation of point clouds remains challenging because of the sparse and unordered data structure. This paper proposes the GSECnet Ground Segmentation network for Edge Computing, an efficient ground segmentation framework of point clouds specifically designed to be deployable on a low power edge computing unit. First, raw point clouds are converted into a discretization representation by pillarization. Afterward, features of points within pillars are fed into PointNet to get the corresponding pillars feature map. Then, a depthwise separable U Net with the attention module learns the classification from the pillars feature map with an enormously diminished model parameter size. Our proposed framework is evaluated on SemanticKITTI against both point based and discretization based state of the art learning approaches, and achieves an excellent balance between high accuracy and low computing complexity. Remarkably, our framework achieves the inference runtime of 135.2 Hz on a desktop platform. Moreover, experiments verify that it is deployable on a low power edge computing unit powered 10 watts only.


Evaluation of Cache Attacks on Arm Processors and Secure Caches. Timing based side and covert channels in processor caches continue to be a threat to modern computers. This work shows for the first time a systematic, large scale analysis of Arm devices and the detailed results of attacks the processors are vulnerable to. Compared to x86, Arm uses different architectures, microarchitectural implementations, cache replacement policies, etc., which affects how attacks can be launched, and how security testing for the vulnerabilities should be done. To evaluate security, this paper presents security benchmarks specifically developed for testing Arm processors and their caches. The benchmarks are themselves evaluated with sensitivity tests, which examine how sensitive the benchmarks are to having a correct configuration in the testing phase. Further, to evaluate a large number of devices, this work leverages a novel approach of using a cloud based Arm device testbed for architectural and security research on timing channels and runs the benchmarks on 34 different physical devices. In parallel, there has been much interest in secure caches to defend the various attacks. Consequently, this paper also investigates secure cache architectures using the proposed benchmarks. Especially, this paper implements and evaluates the secure PL and RF caches, showing the security of PL and RF caches, but also uncovers new weaknesses.


Aquanims Area Preserving Animated Transitions in Statistical Data Graphics based on a Hydraulic Metaphor. We propose "aquanims" as new design metaphors for animated transitions that preserve displayed areas during the transformation. Animated transitions are used to facilitate understanding of graphical transformations between different visualizations. Area is key information to preserve during filtering or ordering transitions of area based charts like bar charts, histograms, treemaps, or mosaic plots. As liquids are incompressible fluids, we use a hydraulic metaphor to convey the sense of area preservation during animated transitions in aquanims, graphical objects can change shape, position, color, and even connectedness but not displayed area, as for a liquid contained in a transparent vessel or transferred between such vessels communicating through hidden pipes. We present various aquanims for product plots like bar charts and histograms to accommodate changes in data, in the ordering of bars or in a number of bins, and to provide animated tips. We also consider confusion matrices visualized as fluctuation diagrams and mosaic plots, and show how aquanims can be used to ease the understanding of different classification errors of real data.


Toward Inclusion of Children as Software Engineering Stakeholders. Background A growing amount of software is available to children today. Children use both software that has been explicitly developed for them and software for general users. While they obtain clear benefits from software, such as access to creativity tools and learning resources, children are also exposed to several risks and disadvantages, such as privacy violation, inactivity, or safety risks that can even lead to death. The research and development community is addressing and investigating positive and negative impacts of software for children one by one, but no comprehensive model exists that relates software engineering and children as stakeholders in their own right. Aims The final objective of this line of research is to propose effective ways in which children can be involved in Software Engineering activities as stakeholders. Specifically, in this paper, we investigate the quality aspects that are of interest for children, as quality is a crucial aspect in the development of any kind of software, especially for stakeholders like children. Method Our contribution is based mainly on an analysis of studies at the intersection between Software Engineering (especially software quality) and Child Computer Interaction. Results We identify a set of qualities and a preliminary set of guidelines that can be used by researchers and practitioners in understanding the complex interrelations between Software Engineering and children. Based on the qualities and the guidelines, researchers can design empirical investigations to obtain deeper insights into the phenomenon and propose new Software Engineering knowledge specific for this type of stakeholders. Conclusions This conceptualization is a first step towards a framework to support children as stakeholders in software engineering.


Enabling Fast Deep Learning on Tiny Energy Harvesting IoT Devices. Energy harvesting (EH) IoT devices that operate intermittently without batteries, coupled with advances in deep neural networks (DNNs), have opened up new opportunities for enabling sustainable smart applications. Nevertheless, implementing those computation and memory intensive intelligent algorithms on EH devices is extremely difficult due to the challenges of limited resources and intermittent power supply that causes frequent failures. To address those challenges, this paper proposes a methodology that enables fast deep learning with low energy accelerators for tiny energy harvesting devices. We first propose RAD , a resource aware structured DNN training framework, which employs block circulant matrix and structured pruning to achieve high compression for leveraging the advantage of various vector operation accelerators. A DNN implementation method, ACE , is then proposed that employs low energy accelerators to profit maximum performance with small energy consumption. Finally, we further design FLEX , the system support for intermittent computation in energy harvesting situations. Experimental results from three different DNN models demonstrate that RAD , ACE , and FLEX can enable fast and correct inference on energy harvesting devices with up to 4.26X runtime reduction, up to 7.7X energy reduction with higher accuracy over the state of the art.


Network Augmentation for Tiny Deep Learning. We introduce Network Augmentation (NetAug), a new training method for improving the performance of tiny neural networks. Existing regularization techniques (e.g., data augmentation, dropout) have shown much success on large neural networks by adding noise to overcome over fitting. However, we found these techniques hurt the performance of tiny neural networks. We argue that training tiny models are different from large models rather than augmenting the data, we should augment the model, since tiny models tend to suffer from under fitting rather than over fitting due to limited capacity. To alleviate this issue, NetAug augments the network (reverse dropout) instead of inserting noise into the dataset or the network. It puts the tiny model into larger models and encourages it to work as a sub model of larger models to get extra supervision, in addition to functioning as an independent model. At test time, only the tiny model is used for inference, incurring zero inference overhead. We demonstrate the effectiveness of NetAug on image classification and object detection. NetAug consistently improves the performance of tiny models, achieving up to 2.2 accuracy improvement on ImageNet. On object detection, achieving the same level of performance, NetAug requires 41 fewer MACs on Pascal VOC and 38 fewer MACs on COCO than the baseline.


An Effective Early Multi core System Shared Cache Design Method Based on Reuse distance Analysis. In this paper, we proposed an effective and efficient multi core shared cache design optimization approach based on reuse distance analysis of the data traces of target applications. Since data traces are independent of system hardware architectures, a designer can easily compute the best cache design at the early system design phase using our approach. We devise a very efficient and yet accurate method to derive the aggregated reuse distance histograms of concurrent applications for accurate cache performance analysis and optimization. Essentially, the actual shared cache contention results of concurrent applications are embedded in the aggregated reuse distance histograms and therefore the approach is very effective. The experimental results show that the average error rate of shared cache miss count estimations of our approach is less than 2.4 . Using a simple scanning search method, one can easily determine the true optimal cache configurations at the early system design phase.


Constrained Synchronization and Subset Synchronization Problems for Weakly Acyclic Automata. We investigate the constrained synchronization problem for weakly acyclic, or partially ordered, input automata. We show that, for input automata of this type, the problem is always in NP. Furthermore, we give a full classification of the realizable complexities for constraint automata with at most two states and over a ternary alphabet. We find that most constrained problems that are PSPACE complete in general become NP complete. However, there also exist constrained problems that are PSPACE complete in the general setting but become polynomial time solvable when considered for weakly acyclic input automata. We also investigate two problems related to subset synchronization, namely if there exists a word mapping all states into a given target subset of states, and if there exists a word mapping one subset into another. Both problems are PSPACE complete in general, but in our setting the former is polynomial time solvable and the latter is NP complete.


On the Ulam Type Stability of Nonlinear Volterra Integral Equations. In this paper, we examine the Hyers Ulam and Hyers Ulam Rassias stability of solutions of a general class of nonlinear Volterra integral equations. By using a fixed point alternative and improving a technique commonly used in similar problems, we extend and improve some well known results on this problem. We also provide some examples visualizing the improvement of the results mentioned.


Learning to Iteratively Solve Routing Problems with Dual Aspect Collaborative Transformer. Recently, Transformer has become a prevailing deep architecture for solving vehicle routing problems (VRPs). However, it is less effective in learning improvement models for VRP because its positional encoding (PE) method is not suitable in representing VRP solutions. This paper presents a novel Dual Aspect Collaborative Transformer (DACT) to learn embeddings for the node and positional features separately, instead of fusing them together as done in existing ones, so as to avoid potential noises and incompatible correlations. Moreover, the positional features are embedded through a novel cyclic positional encoding (CPE) method to allow Transformer to effectively capture the circularity and symmetry of VRP solutions (i.e., cyclic sequences). We train DACT using Proximal Policy Optimization and design a curriculum learning strategy for better sample efficiency. We apply DACT to solve the traveling salesman problem (TSP) and capacitated vehicle routing problem (CVRP). Results show that our DACT outperforms existing Transformer based improvement models, and exhibits much better generalization performance across different problem sizes on synthetic and benchmark instances, respectively.


Field Study in Deploying Restless Multi Armed Bandits Assisting Non Profits in Improving Maternal and Child Health. The widespread availability of cell phones has enabled non profits to deliver critical health information to their beneficiaries in a timely manner. This paper describes our work to assist non profits that employ automated messaging programs to deliver timely preventive care information to beneficiaries (new and expecting mothers) during pregnancy and after delivery. Unfortunately, a key challenge in such information delivery programs is that a significant fraction of beneficiaries drop out of the program. Yet, non profits often have limited health worker resources (time) to place crucial service calls for live interaction with beneficiaries to prevent such engagement drops. To assist non profits in optimizing this limited resource, we developed a Restless Multi Armed Bandits (RMABs) system. One key technical contribution in this system is a novel clustering method of offline historical data to infer unknown RMAB parameters. Our second major contribution is evaluation of our RMAB system in collaboration with an NGO, via a real world service quality improvement study. The study compared strategies for optimizing service calls to 23003 participants over a period of 7 weeks to reduce engagement drops. We show that the RMAB group provides statistically significant improvement over other comparison groups, reducing 30 engagement drops. To the best of our knowledge, this is the first study demonstrating the utility of RMABs in real world public health settings. We are transitioning our RMAB system to the NGO for real world use.


Tight Ramsey bounds for multiple copies of a graph. The Ramsey number r(G) of a graph G is the smallest integer n such that any 2 colouring of the edges of a clique on n vertices contains a monochromatic copy of G . Determining the Ramsey number of G is a central problem of Ramsey theory with long and illustrious history. Despite this there are precious few classes of graphs G for which the value of r(G) is known exactly. One such family consists of large vertex disjoint unions of a fixed graph H , we denote such a graph, consisting of n copies of H by nH . This classical result was proved by Burr, Erd H o s and Spencer in 1975, who showed r(nH) (2 H alpha(H))n c , for some c c(H) , provided n is large enough. Since it did not follow from their arguments, Burr, Erd H o s and Spencer further asked to determine the number of copies we need to take in order to see this long term behaviour and the value of c . More than 30 years ago Burr gave a way of determining c(H) , which only applies when the number of copies n is triple exponential in H . In this paper we give an essentially tight answer to this very old problem of Burr, Erd H o s and Spencer by showing that the long term behaviour occurs already when the number of copies is single exponential.


SEA Graph Shell Attention in Graph Neural Networks. A common issue in Graph Neural Networks (GNNs) is known as over smoothing. By increasing the number of iterations within the message passing of GNNs, the nodes' representations of the input graph align with each other and become indiscernible. Recently, it has been shown that increasing a model's complexity by integrating an attention mechanism yields more expressive architectures. This is majorly contributed to steering the nodes' representations only towards nodes that are more informative than others. Transformer models in combination with GNNs result in architectures including Graph Transformer Layers (GTL), where layers are entirely based on the attention operation. However, the calculation of a node's representation is still restricted to the computational working flow of a GNN. In our work, we relax the GNN architecture by means of implementing a routing heuristic. Specifically, the nodes' representations are routed to dedicated experts. Each expert calculates the representations according to their respective GNN workflow. The definitions of distinguishable GNNs result from k localized views starting from the central node. We call this procedure Graph Shell Attention (SEA), where experts process different subgraphs in a transformer motivated fashion. Intuitively, by increasing the number of experts, the models gain in expressiveness such that a node's representation is solely based on nodes that are located within the receptive field of an expert. We evaluate our architecture on various benchmark datasets showing competitive results compared to state of the art models.


On the Liouville property for fully nonlinear equations with superlinear first order terms. We consider in this note one side Liouville properties for viscosity solutions of various fully nonlinear uniformly elliptic inequalities, whose prototype is F(x,D 2u) geq H i(x,u,Du) in mathbb R N , where H i has superlinear growth in the gradient variable. After a brief survey on the existing literature, we discuss the validity or the failure of the Liouville property in the model cases H 1(u,Du) u q Du gamma , H 2(u,Du) u q Du gamma and H 3(x,u,Du) pm u q Du gamma b(x) cdot Du , where q geq0 , gamma 1 and b is a suitable velocity field. Several counterexamples and open problems are thoroughly discussed.


Should multilevel methods for discontinuous Galerkin discretizations use discontinuous interpolation operators?. Multi level preconditioners for Discontinuous Galerkin (DG) discretizations are widely used to solve elliptic equations, and a main ingredient of such solvers is the interpolation operator to transfer information from the coarse to the fine grid. Classical interpolation operators give continuous interpolated values, but since DG solutions are naturally discontinuous, one might wonder if one should not use discontinuous interpolation operators for DG discretizations. We consider a discontinuous interpolation operator with a parameter that controls the discontinuity, and determine the optimal choice for the discontinuity, leading to the fastest solver for a specific 1D symmetric interior penalty DG discretization model problem. We show in addition that our optimization delivers a perfectly clustered spectrum with a high geometric multiplicity, which is very advantageous for a Krylov solver using the method as its preconditioner. Finally, we show the applicability of the optimal choice to higher dimensions.


Does QRAT simulate IR calc? QRAT simulation algorithm for forall Exp Res cannot be lifted to IR calc. We show that the QRAT simulation algorithm of forall Exp Res from B. Kiesl and M. Seidl, 2019 cannot be lifted to IR calc.


Towards an Adaptive and Normative Multi Agent System Metamodel and Language Existing Approaches and Research Opportunities. Several Multi Agent System (MAS) metamodels and languages have been proposed in the literature to support the development of agent based applications. MAS metamodels are used to capture a collection of concepts the relevant entities and relationships in the MAS domain, which include entities such as agent, message, role, action and plan, and relationships that represent, for example, that a role is responsible for one or more tasks. In addition, to models, MAS modeling languages have also been used to support the development of MASs in a wide variety of domains, including social networking, robotics, security and smart city environments. However, there is a lack of support in these models and languages for abstractions involving norms and adaptations as well as their interactions. This paper presents a survey of some existing metamodels and languages and compares their expressiveness using abstractions related to agents, norms and adaptation. The comparison serves as a basis for the definition of a new MAS metamodeling.


Boundary unique continuation on C 1 Dini domains and the size of the singular set. Let u be a harmonic function in a C 1 Dini domain D such that u vanishes on a boundary surface ball partial D cap B 5R (0) . We consider an effective version of its singular set (up to boundary) mathcal S (u) X in overline D u(X) nabla u(X) 0 and give an estimate of its (d 2) dimensional Minkowski content, which only depends on the upper bound of some modified frequency function of u centered at 0 . Such results are already known in the interior and at the boundary of convex domains, when the standard frequency function is monotone at every point. The novelty of our work on Dini domains is how to compensate for the lack of such monotone quantities at boundary as well as interior points.


Agent Centric Relation Graph for Object Visual Navigation. Object visual navigation aims to steer an agent towards a target object based on visual observations of the agent. It is highly desirable to reasonably perceive the environment and accurately control the agent. In the navigation task, we introduce an Agent Centric Relation Graph (ACRG) for learning the visual representation based on the relationships in the environment. ACRG is a highly effective and reasonable structure that consists of two relationships, i.e., the relationship among objects and the relationship between the agent and the target. On the one hand, we design the Object Horizontal Relationship Graph (OHRG) that stores the relative horizontal location among objects. Note that the vertical relationship is not involved in OHRG, and we argue that OHRG is suitable for the control strategy. On the other hand, we propose the Agent Target Depth Relationship Graph (ATDRG) that enables the agent to perceive the distance to the target. To achieve ATDRG, we utilize image depth to represent the distance. Given the above relationships, the agent can perceive the environment and output navigation actions. Given the visual representations constructed by ACRG and position encoded global features, the agent can capture the target position to perform navigation actions. Experimental results in the artificial environment AI2 Thor demonstrate that ACRG significantly outperforms other state of the art methods in unseen testing environments.


Multipath cohomology of directed graphs. In this paper we introduce a new cohomology theory for (directed) graphs, which we call multipath cohomology. Our construction interpolates between the chromatic homology, introduced by L. Helme Guizon and Y. Rong, and the homology for directed graphs introduced by P. Turner and E. Wagner. We prove that the multipath cohomology satisfies some functorial properties and we describe its connection with chromatic homology. We provide a number of sample computations showing that the multipath cohomology is different from Turner Wagner's and chromatic homologies, it does not vanish on trees, and, when evaluated at the coherent polygon, it recovers the Hochschild homology. We conclude by presenting some open questions and related problems.


Contractive inequalities for mixed norm spaces and the Beta function. For a wide range of pairs of mixed norm spaces such that one space is contained in another, we characterize all cases when contractive norm inequalities hold. In particular, this yields such results for many pairs of weighted Bergman spaces. Some inequalities of this type are motivated by their applications in Number Theory and in Mathematical Physics.


Manipulating SGD with Data Ordering Attacks. Machine learning is vulnerable to a wide variety of attacks. It is now well understood that by changing the underlying data distribution, an adversary can poison the model trained with it or introduce backdoors. In this paper we present a novel class of training time attacks that require no changes to the underlying dataset or model architecture, but instead only change the order in which data are supplied to the model. In particular, we find that the attacker can either prevent the model from learning, or poison it to learn behaviours specified by the attacker. Furthermore, we find that even a single adversarially ordered epoch can be enough to slow down model learning, or even to reset all of the learning progress. Indeed, the attacks presented here are not specific to the model or dataset, but rather target the stochastic nature of modern learning procedures. We extensively evaluate our attacks on computer vision and natural language benchmarks to find that the adversary can disrupt model training and even introduce backdoors.


Duck swarm algorithm a novel swarm intelligence algorithm. A swarm intelligence based optimization algorithm, named Duck Swarm Algorithm (DSA), is proposed in this paper. This algorithm is inspired by the searching for food sources and foraging behaviors of the duck swarm. The performance of DSA is verified by using eighteen benchmark functions, where it is statistical (best, mean, standard deviation, and average running time) results are compared with seven well known algorithms like Particle swarm optimization (PSO), Firefly algorithm (FA), Chicken swarm optimization (CSO), Grey wolf optimizer (GWO), Sine cosine algorithm (SCA), and Marine predators algorithm (MPA), and Archimedes optimization algorithm (AOA). Moreover, the Wilcoxon rank sum test, Friedman test, and convergence curves of the comparison results are used to prove the superiority of the DSA against other algorithms. The results demonstrate that DSA is a high performance optimization method in terms of convergence speed and exploration exploitation balance for solving high dimension optimization functions. Also, DSA is applied for the optimal design of two constrained engineering problems (the Three bar truss problem, and the Sawmill operation problem). Additionally, four engineering constraint problems have also been used to analyze the performance of the proposed DSA. Overall, the comparison results revealed that the DSA is a promising and very competitive algorithm for solving different optimization problems.


Learning to Bid in Contextual First Price Auctions. In this paper, we investigate the problem about how to bid in repeated contextual first price auctions. We consider a single bidder (learner) who repeatedly bids in the first price auctions at each time t , the learner observes a context x t in mathbb R d and decides the bid based on historical information and x t . We assume a structured linear model of the maximum bid of all the others m t alpha 0 cdot x t z t , where alpha 0 in mathbb R d is unknown to the learner and z t is randomly sampled from a noise distribution mathcal F with log concave density function f . We consider both emph binary feedback (the learner can only observe whether she wins or not) and emph full information feedback (the learner can observe m t ) at the end of each time t . For binary feedback, when the noise distribution mathcal F is known, we propose a bidding algorithm, by using maximum likelihood estimation (MLE) method to achieve at most widetilde O ( sqrt log(d) T ) regret. Moreover, we generalize this algorithm to the setting with binary feedback and the noise distribution is unknown but belongs to a parametrized family of distributions. For the full information feedback with emph unknown noise distribution, we provide an algorithm that achieves regret at most widetilde O ( sqrt dT ) . Our approach combines an estimator for log concave density functions and then MLE method to learn the noise distribution mathcal F and linear weight alpha 0 simultaneously. We also provide a lower bound result such that any bidding policy in a broad class must achieve regret at least Omega( sqrt T ) , even when the learner receives the full information feedback and mathcal F is known.


Dynamic Texture Recognition via Nuclear Distances on Kernelized Scattering Histogram Spaces. Distance based dynamic texture recognition is an important research field in multimedia processing with applications ranging from retrieval to segmentation of video data. Based on the conjecture that the most distinctive characteristic of a dynamic texture is the appearance of its individual frames, this work proposes to describe dynamic textures as kernelized spaces of frame wise feature vectors computed using the Scattering transform. By combining these spaces with a basis invariant metric, we get a framework that produces competitive results for nearest neighbor classification and state of the art results for nearest class center classification.


Saddle solutions for the fractional Choquard equation. We study the saddle solutions for the fractional Choquard equation begin align ( Delta) s u u (K alpha ast u p ) u p 2 u, quad x in mathbb R N end align where s in(0,1) , N geq 3 and K alpha is the Riesz potential with order alpha in (0,N) . For every Coxeter group G with rank 1 leq k leq N and p in 2, frac N alpha N 2s ) , we construct a G saddle solution with prescribed symmetric nodal configurations. This is a counterpart for the fractional Choquard equation of saddle solutions to the Choquard equation and further completes the existence of non radial sign changing solutions for this doubly nonlocal equation.


Differentiability with respect to the initial condition for Hamilton Jacobi equations. We prove that the viscosity solution to a Hamilton Jacobi equation with a smooth convex Hamiltonian of the form H(x,p) is differentiable with respect to the initial condition. Moreover, the directional G ateaux derivatives can be explicitly computed almost everywhere in mathbb R N by means of the optimality system of the associated optimal control problem. We also prove that, in the one dimensional case in space and in the quadratic case in any space dimension, these directional G ateaux derivatives actually correspond to the unique duality solution to the linear transport equation with discontinuous coefficient, resulting from the linearization of the Hamilton Jacobi equation. The motivation behind these differentiability results arises from the following optimal inverse design problem given a time horizon T 0 and a target function u T , construct an initial condition such that the corresponding viscosity solution at time T minimizes the L 2 distance to u T . Our differentiability results allow us to derive a necessary first order optimality condition for this optimization problem, and the implementation of gradient based methods to numerically approximate the optimal inverse design.


Huge Reflection. We study Structural Reflection beyond Vop v e nka's Principle, at the level of almost huge cardinals and higher, up to rank into rank embeddings. We identify and classify new large cardinal notions in that region that correspond to some form of what we call Exact Structural Reflection ( mathrm ESR ). Namely, given cardinals kappa lambda and a class mathcal C of structures of the same type, the corresponding instance of mathrm ESR asserts that for every structure A in mathcal C of rank lambda , there is a structure B in mathcal C of rank kappa and an elementary embedding of B into A . Inspired by the statement of Chang's Conjecture, we also introduce and study sequential forms of mathrm ESR , which, in the case of sequences of length omega , turn out to be very strong. Indeed, when restricted to Pi 1 definable classes of structures they follow from the existence of I1 embeddings, while for more complicated classes of structures, e.g., Sigma 2 , they are not known to be consistent. Thus, these principles unveil a new class of large cardinals that go beyond I1 embeddings, yet they may not fall into Kunen's Inconsistency.


Alexandrov Fenchel type inequalities in the sphere. In this paper, we attempt to use two types of flows to study the relations between quermassintegrals mathcal A k (see Definition 1.1), which correspond to the Alexandrov Fenchel inequalities for closed convex C 2 hypersurfaces in mathbb S n 1 .