Gamma graphic delta matroids and their applications. For an abelian group Gamma , a Gamma labelled graph is a graph whose vertices are labelled by elements of Gamma . We prove that a certain collection of edge sets of a Gamma labelled graph forms a delta matroid, which we call a Gamma graphic delta matroid, and provide a polynomial time algorithm to solve the separation problem, which allows us to apply the symmetric greedy algorithm of Bouchet to find a maximum weight feasible set in such a delta matroid. We present two algorithmic applications on graphs Maximum Weight Packing of Trees of Order Not Divisible by k and Maximum Weight S Tree Packing. We also discuss various properties of Gamma graphic delta matroids.


The Automorphism Group of NU(3,q 2) . Let H(n, q 2) be a non degenerate Hermitian variety of PG(n,q 2) , n geq 2 . Let NU(n 1,q 2) be the graph whose vertices are the points of PG(n,q 2) setminus H(n,q 2) and two vertices u, v are adjacent if the line joining u and v is tangent to H(n, q 2 ) . Then NU(n 1, q 2) is a strongly regular graph. In this paper we show that the automorphism group of the graph NU(3,q 2) is isomorphic either to P Gamma U(3,q) , the automorphism group of the projective unitary group PGU(3,q) , or to S 3 wr S 4 , according as q neq 2 , or q 2 .


A Token level Reference free Hallucination Detection Benchmark for Free form Text Generation. Large pretrained generative models like GPT 3 often suffer from hallucinating non existent or incorrect content, which undermines their potential merits in real applications. Existing work usually attempts to detect these hallucinations based on a corresponding oracle reference at a sentence or document level. However ground truth references may not be readily available for many free form text generation applications, and sentence or document level detection may fail to provide the fine grained signals that would prevent fallacious content in real time. As a first step to addressing these issues, we propose a novel token level, reference free hallucination detection task and an associated annotated dataset named HaDes (HAllucination DEtection dataSet). To create this dataset, we first perturb a large number of text segments extracted from English language Wikipedia, and then verify these with crowd sourced annotations. To mitigate label imbalance during annotation, we utilize an iterative model in loop strategy. We conduct comprehensive data analyses and create multiple baseline models.


On the Quot scheme mathrm Quot l ( mathscr E ) . We study the Quot scheme mathrm Quot l( mathscr E ) of length l coherent sheaf quotients of a locally free sheaf mathscr E on a smooth projective surface. We conjecture that the singularities of mathrm Quot l( mathscr E ) are rational. For l 2 we use the ADHM description to show that this conjecture holds, and in fact exhibit a modular resolution of singularities this leads us to a sheaf theoretic generalisation of Severi's double point formula. Given a short exact sequence 0 rightarrow mathscr E ' rightarrow mathscr E rightarrow mathscr E '' rightarrow 0 , we show that mathrm Quot l( mathscr E '' ) subset mathrm Quot l( mathscr E ) is the zero scheme of a regular section of the tautological sheaf mathscr E ' vee l , which results in a relation between the (ordinary and virtual) fundamental classes of mathrm Quot l( mathscr E '' ) and mathrm Quot l( mathscr E ) .


Improving Video Text Retrieval by Multi Stream Corpus Alignment and Dual Softmax Loss. Employing large scale pre trained model CLIP to conduct video text retrieval task (VTR) has become a new trend, which exceeds previous VTR methods. Though, due to the heterogeneity of structures and contents between video and text, previous CLIP based models are prone to overfitting in the training phase, resulting in relatively poor retrieval performance. In this paper, we propose a multi stream Corpus Alignment network with single gate Mixture of Experts (CAMoE) and a novel Dual Softmax Loss (DSL) to solve the two heterogeneity. The CAMoE employs Mixture of Experts (MoE) to extract multi perspective video representations, including action, entity, scene, etc., then align them with the corresponding part of the text. In this stage, we conduct massive explorations towards the feature extraction module and feature alignment module. DSL is proposed to avoid the one way optimum match which occurs in previous contrastive methods. Introducing the intrinsic prior of each pair in a batch, DSL serves as a reviser to correct the similarity matrix and achieves the dual optimal match. DSL is easy to implement with only one line code but improves significantly. The results show that the proposed CAMoE and DSL are of strong efficiency, and each of them is capable of achieving State of The Art (SOTA) individually on various benchmarks such as MSR VTT, MSVD, and LSMDC. Further, with both of them, the performance is advanced to a big extend, surpassing the previous SOTA methods for around 4.6 R 1 in MSR VTT.


From limited observations to the state of turbulence Fundamental difficulties of flow reconstruction. Numerical simulations of turbulence provide non intrusive access to all the resolved scales, although they often invoke idealizations that can compromise realism. In contrast, experimental measurements probe the true flow with lesser idealizations, but they continually contend with spatio temporal sensor resolution. Assimilating observations directly in simulations can combine the benefits of both approaches. The problem is expressed in variational form, where we seek a Navier Stokes solution that minimizes a cost function defined in terms of the deviation of numerical predictions and observations. In this framework, measurements are no longer a mere record of the instantaneous, local quantity, but rather an encoding of the antecedent flow events that we aim to decode using the governing equations. We examine three state estimation problems In circular Couette flow, starting from wall stress data, we accurately reconstruct the nonlinear saturated wavy Taylor vortices. Through a discussion of transition to chaos in a Lorenz system, we highlight the challenge of navigating the landscape of the cost function, and how the landscape can be modified by sensor placement. In turbulent channel flow, the Taylor microscale and Lyapunov timescale place restrictions on the resolution of observations that ensure an accurate reconstruction of all the scales. The notion of domain of dependence of an observation is introduced and related to the Hessian of the cost function. For measurements of wall stress, the eigenspectrum of the Hessian demonstrates the sensitivity of short time observations to the near wall turbulent scales and to outer large scales. At long times, backward chaos obfuscates the interpretation of the data observations that are infinitesimally close may be traced back to entirely different earlier flow states a dual to the more common butterfly effect for forward trajectories.


Data driven modeling of time domain induced polarization. We present a novel approach for data driven modeling of the time domain induced polarization (IP) phenomenon using variational autoencoders (VAE). VAEs are Bayesian neural networks that aim to learn a latent statistical distribution to encode extensive data sets as lower dimension representations. We collected 1 600 319 IP decay curves in various regions of Canada, the United States and Kazakhstan, and compiled them to train a deep VAE. The proposed deep learning approach is strictly unsupervised and data driven it does not require manual processing or ground truth labeling of IP data. Moreover, our VAE approach avoids the pitfalls of IP parametrization with the empirical Cole Cole and Debye decomposition models, simple power law models, or other sophisticated mechanistic models. We demonstrate four applications of VAEs to model and process IP data (1) representative synthetic data generation, (2) unsupervised Bayesian denoising and data uncertainty estimation, (3) quantitative evaluation of the signal to noise ratio, and (4) automated outlier detection. We also interpret the IP compilation's latent representation and reveal a strong correlation between its first dimension and the average chargeability of IP decays. Finally, we experiment with varying VAE latent space dimensions and demonstrate that a single real valued scalar parameter contains sufficient information to encode our extensive IP data compilation. This new finding suggests that modeling time domain IP data using mathematical models governed by more than one free parameter is ambiguous, whereas modeling only the average chargeability is justified. A pre trained implementation of our model readily applicable to new IP data from any geolocation is available as open source Python code for the applied geophysics community.


Lower Bounds on the Size of General Branch and Bound Trees. A emph general branch and bound tree is a branch and bound tree which is allowed to use general disjunctions of the form pi top x leq pi 0 , vee , pi top x geq pi 0 1 , where pi is an integer vector and pi 0 is an integer scalar, to create child nodes. We construct a packing instance, a set covering instance, and a Traveling Salesman Problem instance, such that any general branch and bound tree that solves these instances must be of exponential size. We also verify that an exponential lower bound on the size of general branch and bound trees persists when we add Gaussian noise to the coefficients of the cross polytope, thus showing that polynomial size "smoothed analysis" upper bound is not possible. The results in this paper can be viewed as the branch and bound analog of the seminal paper by Chv 'atal et al. cite chvatal1989cutting , who proved lower bounds for the Chv 'atal Gomory rank.


A surprising symmetry for the greedy independent set on Cayley trees. We prove a surprising symmetry between the law of the size G n of the greedy independent set on a uniform Cayley tree mathcal T n of size n and that of its complement. We show that G n has the same law as the number of vertices at even height in mathcal T n rooted at a uniform vertex. This enables us to compute the exact law of the G n . We also give a Markovian construction of the greedy independent set, which highlights the symmetry of G n and whose proof uses a new Markovian exploration of rooted Cayley trees which is of independent interest.


Subnanometer traceability of localization microscopy. In localization microscopy, subnanometer precision is possible but supporting accuracy is challenging, and no study has demonstrated reliable traceability to the International System of Units (SI). To do so, we measure the positions of nanoscale apertures in a reference array by traceable atomic force microscopy, creating a master standard. We perform correlative measurements of this standard by optical microscopy, correcting position errors from optical aberrations by a Zernike calibration. We establish an uncertainty field due to localization errors and scale uncertainty, with regions of position traceability to within a 68 coverage interval of 1.0 nm. These results enable localization metrology with high throughput, which we apply to measure working standards, validating the subnanometer accuracy of lithographic pitch.


A MultiModal Social Robot Toward Personalized Emotion Interaction. Human emotions are expressed through multiple modalities, including verbal and non verbal information. Moreover, the affective states of human users can be the indicator for the level of engagement and successful interaction, suitable for the robot to use as a rewarding factor to optimize robotic behaviors through interaction. This study demonstrates a multimodal human robot interaction (HRI) framework with reinforcement learning to enhance the robotic interaction policy and personalize emotional interaction for a human user. The goal is to apply this framework in social scenarios that can let the robots generate a more natural and engaging HRI framework.


Confidence guided Adaptive Gate and Dual Differential Enhancement for Video Salient Object Detection. Video salient object detection (VSOD) aims to locate and segment the most attractive object by exploiting both spatial cues and temporal cues hidden in video sequences. However, spatial and temporal cues are often unreliable in real world scenarios, such as low contrast foreground, fast motion, and multiple moving objects. To address these problems, we propose a new framework to adaptively capture available information from spatial and temporal cues, which contains Confidence guided Adaptive Gate (CAG) modules and Dual Differential Enhancement (DDE) modules. For both RGB features and optical flow features, CAG estimates confidence scores supervised by the IoU between predictions and the ground truths to re calibrate the information with a gate mechanism. DDE captures the differential feature representation to enrich the spatial and temporal information and generate the fused features. Experimental results on four widely used datasets demonstrate the effectiveness of the proposed method against thirteen state of the art methods.


Frustration critical signed graphs. A signed graph (G, Sigma) is a graph G together with a set Sigma subseteq E(G) of negative edges. A circuit is positive if the product of the signs of its edges is positive. A signed graph (G, Sigma) is balanced if all its circuits are positive. The frustration index l(G, Sigma) is the minimum cardinality of a set E subseteq E(G) such that (G E, Sigma E) is balanced, and (G, Sigma) is k critical if l(G, Sigma) k and l(G e, Sigma e) k , for every e in E(G) . We study decomposition and subdivision of critical signed graphs. We characterize critical signed graphs and completely determine the set of t critical graphs, for t leq 2 and the set S of non decomposable k critical signed graphs which do not contain a decomposable t critical subgraph for every t leq k . We prove that S consists of cyclically 4 edge connected, projective planar cubic graphs. We further construct k critical graphs of S for every k geq 1 .


The Cost of OSCORE and EDHOC for Constrained Devices. Many modern IoT applications rely on the Constrained Application Protocol (CoAP) because of its efficiency and seamless integrability in the existing Internet infrastructure. One of the strategies that CoAP leverages to achieve these characteristics is the usage of proxies. Unfortunately, in order for a proxy to operate, it needs to terminate the (D)TLS channels between clients and servers. Therefore, end to end confidentiality, integrity and authenticity of the exchanged data cannot be achieved. In order to overcome this problem, an alternative to (D)TLS was recently proposed by the Internet Engineering Task Force (IETF). This alternative consists of two novel protocols 1) Object Security for Constrained RESTful Environments (OSCORE) providing authenticated encryption for the payload data and 2) Ephemeral Diffie Hellman Over COSE (EDHOC) providing the symmetric session keys required for OSCORE. In this paper, we present the design of four firmware libraries for these protocols especially targeted for constrained microcontrollers and their detailed evaluation. More precisely, we present the design of uOSCORE and uEDHOC libraries for regular microcontrollers and uOSCORE TEE and uEDHOC TEE libraries for microcontrollers with a Trusted Execution Environment (TEE), such as microcontrollers featuring ARM TrustZone M. Our firmware design for the later class of devices concerns the fact that attackers may exploit common software vulnerabilities, e.g., buffer overflows in the protocol logic, OS or application to compromise the protocol security. uOSCORE TEE and uEDHOC TEE achieve separation of the cryptographic operations and keys from the remainder of the firmware, which could be vulnerable. We present an evaluation of our implementations in terms of RAM FLASH requirements, execution speed and energy on a broad range of microcontrollers.


Emergence of diverse collective behaviors from local topological perception. We present a dynamical model for generic crowds in 2D in which individual agents are aware of their local environment i.e., neighboring agents and domain boundary features and may seek static target locations. Our model incorporates features common to many other "active matter" models like collision avoidance, alignment among agents, and homing toward targets. However, it is novel in key respects the model combines topological and metrical features in a natural manner based upon the local environment of the agent's Voronoi diagram. With only two parameters, it is shown to capture a wide range of collective behaviors.


Optimal Latency Oriented Scheduling in Parallel Queuing Systems. Today, more and more interactive applications, such as augmented virtual reality, haptic Internet, and Industrial Internet of Things, require communication services with guaranteed end to end latency limits, which are difficult to provide over shared communication networks, particularly in the presence of wireless links. Robustness against disturbances affecting individual links can be obtained by coding the information flow in multiple streams to be forwarded across parallel transmission links. This approach, however, requires coding and scheduling algorithms that can adapt to the state of links to take full advantage of path diversity and avoid self induced congestion on some links. To gain some fundamental insights on this challenging problem, in this paper we resort to Markov Decision Process (MDP) theory and abstract the parallel paths as independent queuing systems, whose arrival processes are managed by a common controller that determines the amount of redundancy to be applied to the source messages and the number of (coded) packets to be sent to each queue. The objective is to find the joint coding and scheduling policy that maximizes a certain utility function, e.g., the fraction of source blocks delivered to the destination within a predetermined deadline, despite the variability of the individual connections. We find the optimal redundancy and scheduling strategies by using policy iteration methods. We then analyze the optimal policy in a series of scenarios, highlighting its most important aspects and analyzing ways to improve existing heuristics from the literature.


3D Human Pose, Shape and Texture from Low Resolution Images and Videos. 3D human pose and shape estimation from monocular images has been an active research area in computer vision. Existing deep learning methods for this task rely on high resolution input, which however, is not always available in many scenarios such as video surveillance and sports broadcasting. Two common approaches to deal with low resolution images are applying super resolution techniques to the input, which may result in unpleasant artifacts, or simply training one model for each resolution, which is impractical in many realistic applications. To address the above issues, this paper proposes a novel algorithm called RSC Net, which consists of a Resolution aware network, a Self supervision loss, and a Contrastive learning scheme. The proposed method is able to learn 3D body pose and shape across different resolutions with one single model. The self supervision loss enforces scale consistency of the output, and the contrastive learning scheme enforces scale consistency of the deep features. We show that both these new losses provide robustness when learning in a weakly supervised manner. Moreover, we extend the RSC Net to handle low resolution videos and apply it to reconstruct textured 3D pedestrians from low resolution input. Extensive experiments demonstrate that the RSC Net can achieve consistently better results than the state of the art methods for challenging low resolution images.


The Role of Binance in Bitcoin Volatility Transmission. We analyse high frequency realised volatility dynamics and spillovers in the bitcoin market, focusing on two pairs bitcoin against the US dollar (the main fiat crypto pair) and trading bitcoin against tether (the main crypto crypto pair). We find that the tether margined perpetual contract on Binance is clearly the main source of volatility, continuously transmitting strong flows to all other instruments and receiving only a little volatility. Moreover, we find that (i) during US trading hours, traders pay more attention and are more reactive to prevailing market conditions when updating their expectations and (ii) the crypto market exhibits a higher interconnectedness when traditional Western stock markets are open. Our results highlight that regulators should not only consider spot exchanges offering bitcoin fiat trading but also the tether margined derivatives products available on most unregulated exchanges, most importantly Binance.


NASOA Towards Faster Task oriented Online Fine tuning with a Zoo of Models. Fine tuning from pre trained ImageNet models has been a simple, effective, and popular approach for various computer vision tasks. The common practice of fine tuning is to adopt a default hyperparameter setting with a fixed pre trained model, while both of them are not optimized for specific tasks and time constraints. Moreover, in cloud computing or GPU clusters where the tasks arrive sequentially in a stream, faster online fine tuning is a more desired and realistic strategy for saving money, energy consumption, and CO2 emission. In this paper, we propose a joint Neural Architecture Search and Online Adaption framework named NASOA towards a faster task oriented fine tuning upon the request of users. Specifically, NASOA first adopts an offline NAS to identify a group of training efficient networks to form a pretrained model zoo. We propose a novel joint block and macro level search space to enable a flexible and efficient search. Then, by estimating fine tuning performance via an adaptive model by accumulating experience from the past tasks, an online schedule generator is proposed to pick up the most suitable model and generate a personalized training regime with respect to each desired task in a one shot fashion. The resulting model zoo is more training efficient than SOTA models, e.g. 6x faster than RegNetY 16GF, and 1.7x faster than EfficientNetB3. Experiments on multiple datasets also show that NASOA achieves much better fine tuning results, i.e. improving around 2.1 accuracy than the best performance in RegNet series under various constraints and tasks 40x faster compared to the BOHB.


Scaling Up Visual and Vision Language Representation Learning With Noisy Text Supervision. Pre trained representations are becoming crucial for many NLP and perception tasks. While representation learning in NLP has transitioned to training on raw text without human annotations, visual and vision language representations still rely heavily on curated training datasets that are expensive or require expert knowledge. For vision applications, representations are mostly learned using datasets with explicit class labels such as ImageNet or OpenImages. For vision language, popular datasets like Conceptual Captions, MSCOCO, or CLIP all involve a non trivial data collection (and cleaning) process. This costly curation process limits the size of datasets and hence hinders the scaling of trained models. In this paper, we leverage a noisy dataset of over one billion image alt text pairs, obtained without expensive filtering or post processing steps in the Conceptual Captions dataset. A simple dual encoder architecture learns to align visual and language representations of the image and text pairs using a contrastive loss. We show that the scale of our corpus can make up for its noise and leads to state of the art representations even with such a simple learning scheme. Our visual representation achieves strong performance when transferred to classification tasks such as ImageNet and VTAB. The aligned visual and language representations enables zero shot image classification and also set new state of the art results on Flickr30K and MSCOCO image text retrieval benchmarks, even when compared with more sophisticated cross attention models. The representations also enable cross modality search with complex text and text image queries.


A new compressed cover tree guarantees a near linear parameterized complexity for all k nearest neighbors search in metric spaces. This paper studies the classical problem of finding all k nearest neighbors to points of a query set Q in another reference set R within any metric space. The well known work by Beygelzimer, Kakade, and Langford in 2006 introduced cover trees and claimed to guarantee a near linear time complexity in the size R of the reference set for k 1 . Our previous work defined compressed cover trees and corrected the key arguments for k geq 1 and previously unknown challenging data cases. In 2009 Ram, Lee, March, and Gray attempted to improve the time complexity by using pairs of cover trees on the query and reference sets. In 2015 Curtin with the above co authors used extra parameters to finally prove a similar complexity for k 1 . Our work fills all previous gaps and substantially improves the neighbor search based on pairs of new compressed cover trees. The novel imbalance parameter of paired trees allowed us to prove a better time complexity for any number of neighbors k geq 1 .


Conterfactual Generative Zero Shot Semantic Segmentation. zero shot learning is an essential part of computer vision. As a classical downstream task, zero shot semantic segmentation has been studied because of its applicant value. One of the popular zero shot semantic segmentation methods is based on the generative model Most new proposed works added structures on the same architecture to enhance this model. However, we found that, from the view of causal inference, the result of the original model has been influenced by spurious statistical relationships. Thus the performance of the prediction shows severe bias. In this work, we consider counterfactual methods to avoid the confounder in the original model. Based on this method, we proposed a new framework for zero shot semantic segmentation. Our model is compared with baseline models on two real world datasets, Pascal VOC and Pascal Context. The experiment results show proposed models can surpass previous confounded models and can still make use of additional structures to improve the performance. We also design a simple structure based on Graph Convolutional Networks (GCN) in this work.


Development of a GPU accelerated Monte Carlo dose calculation module for nuclear medicine, ARCHER NM Demonstration for a PET CT imaging procedure. This paper describes the development and validation of a Monte Carlo (MC) dose computing module dedicated to organ dose calculations of patients undergoing nuclear medicine (NM) internal radiation exposures involving 18F FDG PET CT examination. This new module extends the more than 10 years long ARCHER project that developed a GPU accelerated MC dose engine by adding dedicated NM source definition features. To validate the code, we compared dose distributions from the 0.511 MeV point photon source calculated for a water phantom as well as a patient PET CT phantom against a well tested MC code, GATE. The water phantom results show excellent agreement, suggesting that the radiation physics module in the new NM code is adequate. To demonstrate the clinical utility and advantage of ARCHER NM, one set of PET CT data for an adult male NM patient is calculated using the new code. Radiosensitive organs in the CT dataset are segmented using a CNN based tool called DeepViewer. The PET image intensity maps are converted to radioactivity distributions to allow for MC radiation transport dose calculations at the voxel level. The dose rate maps and corresponding statistical uncertainties were calculated for the duration of PET image acquisition. The dose rate results of the 18F FDG PET imaging patient show that ARCHER NM's results agree very well with those of the GATE within 0.58 to 4.11 . Most impressively, ARCHER NM obtains such results in less than 0.5 minutes while it takes GATE as much as 376 minutes. This is the first study presenting GPU accelerated patient specific MC internal radiation dose rate calculations for clinically realistic 18F FDG PET CT imaging cases involving auto segmentation of whole body PET CT images. This study suggests that modern computing tools ARCHER NM and DeepViewer are accurate and fast enough for routine internal dosimetry in NM clinics.


A Review of Game based Mobile E Learning Applications. This study aims to review and get information on the different mobile game applications and the possibility of being a supplementary tool for learning to enhance and empower the e Learning aspect of a Technical Education and Skills Development Authority. It is reviewed to help in the development of the eLearning department of TESDA. The study aims to facilitate the reorganization of the E learning program of TESDA by using a method called Game Based Learning. To accomplish this target, different applications will be reviewed to give an idea on how game based learning is being used as a supplementary learning tool for different subject areas. This paper will focus on TESDA language Skills institute and Technical Vocational program since there are a lot of reviews for main subject areas but only few in this field. The database to be used in the methodology is Google Scholar, inclusion and exclusion criteria used is that article should be within the span of five years and should be game based learning mobile applications. Will be selecting 4 applications as a representation since it is an informational review. No need to indicate the other applications as this is just a basis for future studies. Mobile games have such a powerful instructional potential, by which teaching can be revolutionized, which output is acquiring the praise and judgment of academic professionals and educators. After this review, future studies can be made to support this study like reviewing from other databases like Web of Science and Scopus to support the foundation made on this review. The review will open further studies to help TESDA administrator in using mobile games as a supplementary learning tool for their e learning.


A Joint Inversion Segmentation approach to Assisted Seismic Interpretation. Structural seismic interpretation and quantitative characterization are historically intertwined processes. The latter provides estimates of properties of the subsurface which can be used to aid structural interpretation alongside the original seismic data and a number of other seismic attributes. In this work, we redefine this process as a inverse problem which tries to jointly estimate subsurface properties (i.e., acoustic impedance) and a piece wise segmented representation of the subsurface based on user defined macro classes. By inverting for the quantities simultaneously, the inversion is primed with prior knowledge about the regions of interest, whilst at the same time it constrains this belief with the actual seismic measurements. As the proposed functional is separable in the two quantities, these are optimized in an alternating fashion, where each subproblem is solved using a Primal Dual algorithm. Subsequently, each class is used as input to a workflow which aims to extract the perimeter of the detected shapes and to produce unique horizons. The effectiveness of the proposed method is illustrated through numerical examples on synthetic and field datasets.


Embeddings between weighted Tandori and Ces a ro Function Spaces. We give the characterization of the embeddings between weighted Tandori and Ces a ro function spaces using the combination of duality arguments for weighted Lebesgue spaces and weighted Tandori spaces with estimates for the iterated integral operators.


IMBENS Ensemble Class imbalanced Learning in Python. imbalanced ensemble, abbreviated as imbens, is an open source Python toolbox for quick implementing and deploying ensemble learning algorithms on class imbalanced data. It provides access to multiple state of art ensemble imbalanced learning (EIL) methods, visualizer, and utility functions for dealing with the class imbalance problem. These ensemble methods include resampling based, e.g., under over sampling, and reweighting based ones, e.g., cost sensitive learning. Beyond the implementation, we also extend conventional binary EIL algorithms with new functionalities like multi class support and resampling scheduler, thereby enabling them to handle more complex tasks. The package was developed under a simple, well documented API design follows that of scikit learn for increased ease of use. imbens is released under the MIT open source license and can be installed from Python Package Index (PyPI). Source code, binaries, detailed documentation, and usage examples are available at https github.com ZhiningLiu1998 imbalanced ensemble.


Efficient Decoding of Gabidulin Codes over Galois Rings. This paper presents the first decoding algorithm for Gabidulin codes over Galois rings with provable quadratic complexity. The new method consists of two steps (1) solving a syndrome based key equation to obtain the annihilator polynomial of the error and therefore the column space of the error, (2) solving a key equation based on the received word in order to reconstruct the error vector. This two step approach became necessary since standard solutions as the Euclidean algorithm do not properly work over rings.


On the well posedness of the time fractional diffusion equation with Robin boundary condition. The diffusion system with time fractional order derivative is of great importance mathematically due to the nonlocal property of the fractional order derivative, which can be applied to model the physical phenomena with memory effects. We consider an initial boundary value problem for the time fractional diffusion equation with inhomogenous Robin boundary condition. Firstly, we show the unique existence of the weak strong solution based on the eigenfunction expansions, which ensures the well posedness of the direct problem. Then, we establish the Hopf lemma for time fractional diffusion operator, generalizing the counterpart for the classical parabolic equation. Based on this new Hopf lemma, the maximum principles for this time fractional diffusion are finally proven, which play essential roles for further studying the uniqueness of the inverse problems corresponding to this system.


Adversarial Memory Networks for Action Prediction. Action prediction aims to infer the forthcoming human action with partially observed videos, which is a challenging task due to the limited information underlying early observations. Existing methods mainly adopt a reconstruction strategy to handle this task, expecting to learn a single mapping function from partial observations to full videos to facilitate the prediction process. In this study, we propose adversarial memory networks (AMemNet) to generate the "full video" feature conditioning on a partial video query from two new aspects. Firstly, a key value structured memory generator is designed to memorize different partial videos as key memories and dynamically write full videos in value memories with gating mechanism and querying attention. Secondly, we develop a class aware discriminator to guide the memory generator to deliver not only realistic but also discriminative full video features upon adversarial training. The final prediction result of AMemNet is given by late fusion over RGB and optical flow streams. Extensive experimental results on two benchmark video datasets, UCF 101 and HMDB51, are provided to demonstrate the effectiveness of the proposed AMemNet model over state of the art methods.


RTIC Residual Learning for Text and Image Composition using Graph Convolutional Network. In this paper, we study the compositional learning of images and texts for image retrieval. The query is given in the form of an image and text that describes the desired modifications to the image the goal is to retrieve the target image that satisfies the given modifications and resembles the query by composing information in both the text and image modalities. To remedy this, we propose a novel architecture designed for the image text composition task and show that the proposed structure can effectively encode the differences between the source and target images conditioned on the text. Furthermore, we introduce a new joint training technique based on the graph convolutional network that is generally applicable for any existing composition methods in a plug and play manner. We found that the proposed technique consistently improves performance and achieves state of the art scores on various benchmarks. To avoid misleading experimental results caused by trivial training hyper parameters, we reproduce all individual baselines and train models with a unified training environment. We expect this approach to suppress undesirable effects from irrelevant components and emphasize the image text composition module's ability. Also, we achieve the state of the art score without restricting the training environment, which implies the superiority of our method considering the gains from hyper parameter tuning. The code, including all the baseline methods, are released https github.com nashory rtic gcn pytorch.


Domain specific MT for Low resource Languages The case of Bambara French. Translating to and from low resource languages is a challenge for machine translation (MT) systems due to a lack of parallel data. In this paper we address the issue of domain specific MT for Bambara, an under resourced Mande language spoken in Mali. We present the first domain specific parallel dataset for MT of Bambara into and from French. We discuss challenges in working with small quantities of domain specific data for a low resource language and we present the results of machine learning experiments on this data.


Satisfiability and Synthesis Modulo Oracles. In classic program synthesis algorithms, such as counterexample guided inductive synthesis (CEGIS), the algorithms alternate between a synthesis phase and an oracle (verification) phase. Many synthesis algorithms use a white box oracle based on satisfiability modulo theory (SMT) solvers to provide counterexamples. But what if a white box oracle is either not available or not easy to work with? We present a framework for solving a general class of oracle guided synthesis problems which we term synthesis modulo oracles. In this setting, oracles may be black boxes with a query response interface defined by the synthesis problem. As a necessary component of this framework, we also formalize the problem of satisfiability modulo theories and oracles, and present an algorithm for solving this problem. We implement a prototype solver for satisfiability and synthesis modulo oracles and demonstrate that, by using oracles that execute functions not easily modeled in SMT constraints, such as recursive functions or oracles that incorporate compilation and execution of code, SMTO and SyMO are able to solve problems beyond the abilities of standard SMT and synthesis solvers.


Active Exploration and Mapping via Iterative Covariance Regulation over Continuous SE(3) Trajectories. This paper develops emph iterative Covariance Regulation (iCR), a novel method for active exploration and mapping for a mobile robot equipped with on board sensors. The problem is posed as optimal control over the SE(3) pose kinematics of the robot to minimize the differential entropy of the map conditioned the potential sensor observations. We introduce a differentiable field of view formulation, and derive iCR via the gradient descent method to iteratively update an open loop control sequence in continuous space so that the covariance of the map estimate is minimized. We demonstrate autonomous exploration and uncertainty reduction in simulated occupancy grid environments.


Benchmarking Robustness of Deep Learning Classifiers Using Two Factor Perturbation. This paper adds to the fundamental body of work on benchmarking the robustness of deep learning (DL) classifiers. We innovate a new benchmarking methodology to evaluate robustness of DL classifiers. Also, we introduce a new four quadrant statistical visualization tool, including minimum accuracy, maximum accuracy, mean accuracy, and coefficient of variation, for benchmarking robustness of DL classifiers. To measure robust DL classifiers, we created a comprehensive 69 benchmarking image set, including a clean set, sets with single factor perturbations, and sets with two factor perturbation conditions. After collecting experimental results, we first report that using two factor perturbed images improves both robustness and accuracy of DL classifiers. The two factor perturbation includes (1) two digital perturbations (salt pepper noise and Gaussian noise) applied in both sequences, and (2) one digital perturbation (salt pepper noise) and a geometric perturbation (rotation) applied in both sequences. All source codes, related image sets, and preliminary data, figures are shared on a GitHub website to support future academic research and industry projects. The web resources locate at https github.com caperock robustai


Multi Agent Simulation for AI Behaviour Discovery in Operations Research. We describe ACE0, a lightweight platform for evaluating the suitability and viability of AI methods for behaviour discovery in multiagent simulations. Specifically, ACE0 was designed to explore AI methods for multi agent simulations used in operations research studies related to new technologies such as autonomous aircraft. Simulation environments used in production are often high fidelity, complex, require significant domain knowledge and as a result have high R D costs. Minimal and lightweight simulation environments can help researchers and engineers evaluate the viability of new AI technologies for behaviour discovery in a more agile and potentially cost effective manner. In this paper we describe the motivation for the development of ACE0.We provide a technical overview of the system architecture, describe a case study of behaviour discovery in the aerospace domain, and provide a qualitative evaluation of the system. The evaluation includes a brief description of collaborative research projects with academic partners, exploring different AI behaviour discovery methods.


Neighbor Vote Improving Monocular 3D Object Detection through Neighbor Distance Voting. As cameras are increasingly deployed in new application domains such as autonomous driving, performing 3D object detection on monocular images becomes an important task for visual scene understanding. Recent advances on monocular 3D object detection mainly rely on the pseudo LiDAR'' generation, which performs monocular depth estimation and lifts the 2D pixels to pseudo 3D points. However, depth estimation from monocular images, due to its poor accuracy, leads to inevitable position shift of pseudo LiDAR points within the object. Therefore, the predicted bounding boxes may suffer from inaccurate location and deformed shape. In this paper, we present a novel neighbor voting method that incorporates neighbor predictions to ameliorate object detection from severely deformed pseudo LiDAR point clouds. Specifically, each feature point around the object forms their own predictions, and then the consensus'' is achieved through voting. In this way, we can effectively combine the neighbors' predictions with local prediction and achieve more accurate 3D detection. To further enlarge the difference between the foreground region of interest (ROI) pseudo LiDAR points and the background points, we also encode the ROI prediction scores of 2D foreground pixels into the corresponding pseudo LiDAR points. We conduct extensive experiments on the KITTI benchmark to validate the merits of our proposed method. Our results on the bird's eye view detection outperform the state of the art performance by a large margin, especially for the hard'' level detection.


The Complexity of Vector Partition. We consider the em vector partition problem , where n agents, each with a d dimensional attribute vector, are to be partitioned into p parts so as to minimize cost which is a given function on the sums of attribute vectors in each part. The problem has applications in a variety of areas including clustering, logistics and health care. We consider the complexity and parameterized complexity of the problem under various assumptions on the natural parameters p,d,a,t of the problem where a is the maximum absolute value of any attribute and t is the number of agent types, and raise some of the many remaining open problems.


Nominal B "uchi Automata with Name Allocation. Infinite words over infinite alphabets serve as models of the temporal development of the allocation and (re )use of resources over linear time. We approach omega languages over infinite alphabets in the setting of nominal sets, and study languages of infinite bar strings, i.e. infinite sequences of names that feature binding of fresh names binding corresponds roughly to reading letters from input words in automata models with registers. We introduce regular nominal nondeterministic B "uchi automata (B "uchi RNNAs), an automata model for languages of infinite bar strings, repurposing the previously introduced RNNAs over finite bar strings. Our machines feature explicit binding (i.e. resource allocating) transitions and process their input via a B "uchi type acceptance condition. They emerge from the abstract perspective on name binding given by the theory of nominal sets. As our main result we prove that, in contrast to most other nondeterministic automata models over infinite alphabets, language inclusion of B "uchi RNNAs is decidable and in fact elementary. This makes B "uchi RNNAs a suitable tool for applications in model checking.


Continuity of Formal Power Series Products in Nonlinear Control Theory. Formal power series products appear in nonlinear control theory when systems modeled by Chen Fliess series are interconnected to form new systems. In fields like adaptive control and learning systems, the coefficients of these formal power series are estimated sequentially with real time data. The main goal of the present article is to prove the continuity and analyticity of such products with respect to several natural (locally convex) topologies on spaces of locally convergent formal power series in order to establish foundational properties behind these technologies. In addition, it is shown that a transformation group central to describing the output feedback connection is in fact an analytic Lie group in this setting with certain regularity properties.


Hierarchical Graph Convolutional Skeleton Transformer for Action Recognition. Graph convolutional networks (GCNs) have emerged as dominant methods for skeleton based action recognition. However, they still suffer from two problems, namely, neighborhood constraints and entangled spatiotemporal feature representations. Most studies have focused on improving the design of graph topology to solve the first problem but they have yet to fully explore the latter. In this work, we design a disentangled spatiotemporal transformer (DSTT) block to overcome the above limitations of GCNs in three steps (i) feature disentanglement for spatiotemporal decomposition (ii) global spatiotemporal attention for capturing correlations in the global context and (iii) local information enhancement for utilizing more local information. Thereon, we propose a novel architecture, named Hierarchical Graph Convolutional skeleton Transformer (HGCT), to employ the complementary advantages of GCN (i.e., local topology, temporal dynamics and hierarchy) and Transformer (i.e., global context and dynamic attention). HGCT is lightweight and computationally efficient. Quantitative analysis demonstrates the superiority and good interpretability of HGCT.


A Note on Reflected BSDEs in Infinite Horizon with Stochastic Lipschitz Coefficients. We consider an infinite horizon, obliquely reflected backward stochastic differential equation (RBSDE). The main contribution of the present work is that we generalize previous results on infinite horizon reflected BSDEs to the setting where the driver has a stochastic Lipschitz coefficient. As an application we consider robust optimal stopping problems for functional stochastic differential equations (FSDEs) where the driver has linear growth.


Small Object Detection for Near Real Time Egocentric Perception in a Manual Assembly Scenario. Detecting small objects in video streams of head worn augmented reality devices in near real time is a huge challenge training data is typically scarce, the input video stream can be of limited quality, and small objects are notoriously hard to detect. In industrial scenarios, however, it is often possible to leverage contextual knowledge for the detection of small objects. Furthermore, CAD data of objects are typically available and can be used to generate synthetic training data. We describe a near real time small object detection pipeline for egocentric perception in a manual assembly scenario We generate a training data set based on CAD data and realistic backgrounds in Unity. We then train a YOLOv4 model for a two stage detection process First, the context is recognized, then the small object of interest is detected. We evaluate our pipeline on the augmented reality device Microsoft Hololens 2.


Fast Batch Nuclear norm Maximization and Minimization for Robust Domain Adaptation. Due to the domain discrepancy in visual domain adaptation, the performance of source model degrades when bumping into the high data density near decision boundary in target domain. A common solution is to minimize the Shannon Entropy to push the decision boundary away from the high density area. However, entropy minimization also leads to severe reduction of prediction diversity, and unfortunately brings harm to the domain adaptation. In this paper, we investigate the prediction discriminability and diversity by studying the structure of the classification output matrix of a randomly selected data batch. We find by theoretical analysis that the prediction discriminability and diversity could be separately measured by the Frobenius norm and rank of the batch output matrix. The nuclear norm is an upperbound of the former, and a convex approximation of the latter. Accordingly, we propose Batch Nuclear norm Maximization and Minimization, which performs nuclear norm maximization on the target output matrix to enhance the target prediction ability, and nuclear norm minimization on the source batch output matrix to increase applicability of the source domain knowledge. We further approximate the nuclear norm by L 1,2 norm, and design multi batch optimization for stable solution on large number of categories. The fast approximation method achieves O(n 2) computational complexity and better convergence property. Experiments show that our method could boost the adaptation accuracy and robustness under three typical domain adaptation scenarios. The code is available at https github.com cuishuhao BNM.


textit StateCensusLaws.org A Web Application for Consuming and Annotating Legal Discourse Learning. In this work, we create a web application to highlight the output of NLP models trained to parse and label discourse segments in law text. Our system is built primarily with journalists and legal interpreters in mind, and we focus on state level law that uses U.S. Census population numbers to allocate resources and organize government. Our system exposes a corpus we collect of 6,000 state level laws that pertain to the U.S. census, using 25 scrapers we built to crawl state law websites, which we release. We also build a novel, flexible annotation framework that can handle span tagging and relation tagging on an arbitrary input text document and be embedded simply into any webpage. This framework allows journalists and researchers to add to our annotation database by correcting and tagging new data.


Causal Reasoning in Simulation for Structure and Transfer Learning of Robot Manipulation Policies. We present CREST, an approach for causal reasoning in simulation to learn the relevant state space for a robot manipulation policy. Our approach conducts interventions using internal models, which are simulations with approximate dynamics and simplified assumptions. These interventions elicit the structure between the state and action spaces, enabling construction of neural network policies with only relevant states as input. These policies are pretrained using the internal model with domain randomization over the relevant states. The policy network weights are then transferred to the target domain (e.g., the real world) for fine tuning. We perform extensive policy transfer experiments in simulation for two representative manipulation tasks block stacking and crate opening. Our policies are shown to be more robust to domain shifts, more sample efficient to learn, and scale to more complex settings with larger state spaces. We also show improved zero shot sim to real transfer of our policies for the block stacking task.


DoS and DDoS Mitigation Using Variational Autoencoders. DoS and DDoS attacks have been growing in size and number over the last decade and existing solutions to mitigate these attacks are in general inefficient. Compared to other types of malicious cyber attacks, DoS and DDoS attacks are particularly more challenging to combat. With their ability to mask themselves as legitimate traffic, developing methods to detect these types of attacks on a packet or flow level, has proven to be a difficult task. In this paper, we explore the potential of Variational Autoencoders to serve as a component within an intelligent security solution that differentiates between normal and malicious traffic. Two methods based on the ability of Variational Autoencoders to learn latent representations from network traffic flows are proposed. The first method resorts to a classifier based on the latent encodings obtained from Variational Autoencoders learned from traffic traces. The second method is rather an anomaly detection method where the Variational Autoencoder is used to learn the abstract feature representations of exclusively legitimate traffic. Then anomalies are filtered out by relying on the reconstruction loss of the Variational Autoencoder. Both of the proposed methods have been thoroughly tested on two separate datasets with a similar feature space. The results show that both methods are promising, with a slight superiority of the classifier based method over the anomaly based one. that the first method is able to successfully detect individual traffic flows with high precision on the training and validation data, slightly less successfully on the test data. For the second method, the Variational Autoencoder will require further adjustments to be able to sufficiently filter out anomalies from network traffic flows.


Sidewise control of 1 d waves. We analyze the sidewise controllability for the variable coefficients one dimensional wave equation. The control is acting on one extreme of the string with the aim that the solution tracks a given path at the other free end. This sidewise control problem is also often referred to as nodal profile or tracking control. First, the problem is reformulated as a dual observability property for the corresponding adjoint system. Using sidewise energy propagation arguments the sidewise observability is shown to hold, in a sufficiently large time, in the class of BV coefficients. We also present a number of open problems and perspectives for further research.


Self supervised Regularization for Text Classification. Text classification is a widely studied problem and has broad applications. In many real world problems, the number of texts for training classification models is limited, which renders these models prone to overfitting. To address this problem, we propose SSL Reg, a data dependent regularization approach based on self supervised learning (SSL). SSL is an unsupervised learning approach which defines auxiliary tasks on input data without using any human provided labels and learns data representations by solving these auxiliary tasks. In SSL Reg, a supervised classification task and an unsupervised SSL task are performed simultaneously. The SSL task is unsupervised, which is defined purely on input texts without using any human provided labels. Training a model using an SSL task can prevent the model from being overfitted to a limited number of class labels in the classification task. Experiments on 17 text classification datasets demonstrate the effectiveness of our proposed method.


Optimal personalised treatment computation through in silico clinical trials on patient digital twins. In Silico Clinical Trials (ISTC), i.e., clinical experimental campaigns carried out by means of computer simulations, hold the promise to decrease time and cost for the safety and efficacy assessment of pharmacological treatments, reduce the need for animal and human testing, and enable precision medicine. In this paper we present methods and an algorithm that, by means of extensive computer simulation based experimental campaigns (ISTC) guided by intelligent search, optimise a pharmacological treatment for an individual patient (precision medicine). e show the effectiveness of our approach on a case study involving a real pharmacological treatment, namely the downregulation phase of a complex clinical protocol for assisted reproduction in humans.


Membership Inference Attacks Against Recommender Systems. Recently, recommender systems have achieved promising performances and become one of the most widely used web applications. However, recommender systems are often trained on highly sensitive user data, thus potential data leakage from recommender systems may lead to severe privacy problems. In this paper, we make the first attempt on quantifying the privacy leakage of recommender systems through the lens of membership inference. In contrast with traditional membership inference against machine learning classifiers, our attack faces two main differences. First, our attack is on the user level but not on the data sample level. Second, the adversary can only observe the ordered recommended items from a recommender system instead of prediction results in the form of posterior probabilities. To address the above challenges, we propose a novel method by representing users from relevant items. Moreover, a shadow recommender is established to derive the labeled training data for training the attack model. Extensive experimental results show that our attack framework achieves a strong performance. In addition, we design a defense mechanism to effectively mitigate the membership inference threat of recommender systems.


CHESSIoT support of event based modeling for the Internet of Things applications. Internet of Things systems design and development suffers from heterogeneity in different aspects. The component behaviors also change due to events being internal or external and the system needs to take action subsequently. In this paper, we demo the event based modeling capabilities of the CHESSIoT tool on a smart parking application. Different components was been decomposed with functional and behavioral specifications following the component based approach. In the end, we have given a brief description of the future work.


I'm all Ears! Listening to Software Developers on Putting GDPR Principles into Software Development Practice. Previous research has been carried out to identify the impediments that prevent developers from incorporating privacy protocols into software applications. No research has been carried out to find out why developers are not able to develop systems that preserve privacy while specifically considering the General Data Protection Regulation principles (GDPR principles). Consequently, this paper aims to examine the issues, which prevent developers from creating applications, which consider and include GDPR principles into their software systems. From our research findings, we identified the lack of familiarity with GDPR principles by developers as one of the obstacles that prevent GDPR onboarding. Those who were familiar with the principles did not have the requisite knowledge about the principles including their techniques. Developers focused on functional than on privacy requirements. Unavailability of resourceful online tools and lack of support from institutions and clients were also identified as issues inimical to the onboarding of GDPR principles.


Exploring Adversarial Learning for Deep Semi Supervised Facial Action Unit Recognition. Current works formulate facial action unit (AU) recognition as a supervised learning problem, requiring fully AU labeled facial images during training. It is challenging if not impossible to provide AU annotations for large numbers of facial images. Fortunately, AUs appear on all facial images, whether manually labeled or not, satisfy the underlying anatomic mechanisms and human behavioral habits. In this paper, we propose a deep semi supervised framework for facial action unit recognition from partially AU labeled facial images. Specifically, the proposed deep semi supervised AU recognition approach consists of a deep recognition network and a discriminator D. The deep recognition network R learns facial representations from large scale facial images and AU classifiers from limited ground truth AU labels. The discriminator D is introduced to enforce statistical similarity between the AU distribution inherent in ground truth AU labels and the distribution of the predicted AU labels from labeled and unlabeled facial images. The deep recognition network aims to minimize recognition loss from the labeled facial images, to faithfully represent inherent AU distribution for both labeled and unlabeled facial images, and to confuse the discriminator. During training, the deep recognition network R and the discriminator D are optimized alternately. Thus, the inherent AU distributions caused by underlying anatomic mechanisms are leveraged to construct better feature representations and AU classifiers from partially AU labeled data during training. Experiments on two benchmark databases demonstrate that the proposed approach successfully captures AU distributions through adversarial learning and outperforms state of the art AU recognition work.


Designing Rotationally Invariant Neural Networks from PDEs and Variational Methods. Partial differential equation (PDE) models and their associated variational energy formulations are often rotationally invariant by design. This ensures that a rotation of the input results in a corresponding rotation of the output, which is desirable in applications such as image analysis. Convolutional neural networks (CNNs) do not share this property, and existing remedies are often complex. The goal of our paper is to investigate how diffusion and variational models achieve rotation invariance and transfer these ideas to neural networks. As a core novelty we propose activation functions which couple network channels by combining information from several oriented filters. This guarantees rotation invariance within the basic building blocks of the networks while still allowing for directional filtering. The resulting neural architectures are inherently rotationally invariant. With only a few small filters, they can achieve the same invariance as existing techniques which require a fine grained sampling of orientations. Our findings help to translate diffusion and variational models into mathematically well founded network architectures, and provide novel concepts for model based CNN design.


Linear Ridge expansions Enhancing linear approximations by ridge functions. We consider approximations formed by the sum of a linear combination of given functions enhanced by ridge functions a Linear Ridge expansion. For an explicitly or implicitly given function, we reformulate finding a best Linear Ridge expansion in terms of an optimization problem. We introduce a particle grid algorithm for its solution. Several numerical results underline the flexibility, robustness and efficiency of the algorithm. One particular source of motivation is model reduction of parameterized transport or wave equations. We show that the particle grid algorithm is able to produce a Linear Ridge expansion as an efficient nonlinear model reduction.


Deep Learning for Embodied Vision Navigation A Survey. "Embodied visual navigation" problem requires an agent to navigate in a 3D environment mainly rely on its first person observation. This problem has attracted rising attention in recent years due to its wide application in autonomous driving, vacuum cleaner, and rescue robot. A navigation agent is supposed to have various intelligent skills, such as visual perceiving, mapping, planning, exploring and reasoning, etc. Building such an agent that observes, thinks, and acts is a key to real intelligence. The remarkable learning ability of deep learning methods empowered the agents to accomplish embodied visual navigation tasks. Despite this, embodied visual navigation is still in its infancy since a lot of advanced skills are required, including perceiving partially observed visual input, exploring unseen areas, memorizing and modeling seen scenarios, understanding cross modal instructions, and adapting to a new environment, etc. Recently, embodied visual navigation has attracted rising attention of the community, and numerous works has been proposed to learn these skills. This paper attempts to establish an outline of the current works in the field of embodied visual navigation by providing a comprehensive literature survey. We summarize the benchmarks and metrics, review different methods, analysis the challenges, and highlight the state of the art methods. Finally, we discuss unresolved challenges in the field of embodied visual navigation and give promising directions in pursuing future research.


Stratification and the comparison between homological and tensor triangular support. We compare the homological support and tensor triangular support for big' objects in a rigidly compactly generated tensor triangulated category. We prove that the comparison map from the homological spectrum to the tensor triangular spectrum is a bijection and that the two notions of support coincide whenever the category is stratified, extending work of Balmer. Moreover, we clarify the relations between salient properties of support functions and exhibit counter examples highlighting the differences between homological and tensor triangular support.


Machine Learning for Multimodal Electronic Health Records based Research Challenges and Perspectives. Background Electronic Health Records (EHRs) contain rich information of patients' health history, which usually include both structured and unstructured data. There have been many studies focusing on distilling valuable information from structured data, such as disease codes, laboratory test results, and treatments. However, relying on structured data only might be insufficient in reflecting patients' comprehensive information and such data may occasionally contain erroneous records. Objective With the recent advances of machine learning (ML) and deep learning (DL) techniques, an increasing number of studies seek to obtain more accurate results by incorporating unstructured free text data as well. This paper reviews studies that use multimodal data, i.e. a combination of structured and unstructured data, from EHRs as input for conventional ML or DL models to address the targeted tasks. Materials and Methods We searched in the Institute of Electrical and Electronics Engineers (IEEE) Digital Library, PubMed, and Association for Computing Machinery (ACM) Digital Library for articles related to ML based multimodal EHR studies. Results and Discussion With the final 94 included studies, we focus on how data from different modalities were combined and interacted using conventional ML and DL techniques, and how these algorithms were applied in EHR related tasks. Further, we investigate the advantages and limitations of these fusion methods and indicate future directions for ML based multimodal EHR research.


Entropy Variance curves of binary sequences generated by random substitutions of constant length. We study some properties of binary sequences generated by random substitutions of constant length. Specifically, assuming the alphabet 0,1 , we consider the following asymmetric substitution rule of length k 0 to langle 0, 0, ldots,0 rangle and 1 to langle Y 1, Y 2, ldots, Y k rangle , where Y i is a Bernoulli random variable with parameter p in 0,1 . We obtain by recurrence the discrete probability distribution of the stochastic variable that counts the number of ones in the sequence formed after a number i of substitutions (iterations). We derive its first two statistical moments, mean and variance, and the entropy of the generated sequences as a function of the substitution length k for any successive iteration i , and characterize the values of p where the maxima of these measures occur. Finally, we obtain the parametric curves entropy variance for each iteration and substitution length. We find two regimes of dependence between these two variables that, to our knowledge, have not been previously described. Besides, it allows to compare sequences with the same entropy but different variance and vice versa.


Cluster Monomials are Dual Canonical. Kang, Kashiwara, Kim and Oh have proved that cluster monomials lie in the dual canonical basis, under a symmetric type assumption. This involves constructing a monoidal categorification of a quantum cluster algebra using representations of KLR algebras. We use a folding technique to generalise their results to all Lie types.


Proceedings Second Joint International Workshop on Linearity Trends in Linear Logic and Applications. This volume contains a selection of papers presented at Linearity TLLA 2020, namely the Second Joint International Workshop on Linearity Trends in Linear Logic and Applications, held on June 29 30, 2020 online. (The workshop was supposed to take place in Paris as part of FSCD 2020, but due to the COVID pandemic it was decided not to hold the event live.) Linearity is a central concept in many theoretical and practical approaches to computer science. On the theoretical side, there is much work stemming from linear logic and dealing with resource control, complexity classes, and more recently quantum computation. On the practical side there is certainly work on program analysis, operational semantics, logic programming languages, program transformations, and efficient implementation techniques. Linear logic is not only a theoretical tool for the analysis of resource usage in logic and computation. It is also a corpus of distinct approaches and methodologies (e.g., proof nets, geometry of interaction, coherent spaces, relational models) that were originally developed for the study of linear logic's syntax and semantics have nowadays found applications in several other fields.


What is Logical in First Order Logic?. In this article, logical concepts are defined using the internal syntactic and semantic structure of language. For a first order language, it has been shown that its logical constants are connectives and a certain type of quantifiers for which the universal and existential quantifiers form a functionally complete set of quantifiers. Neither equality nor cardinal quantifiers belong to the logical constants of a first order language.


Why walks lead us astray in the study of graphs. We show that the commonly held assumption that walks can be used to infer properties of digraphs is highly problematic. Since in particular closed walks are describable from combinations of simple cycles, we study the trace monoid formed by these cycles on a digraph under the rule that two such cycles commute if and only if they are vertex disjoint. We show that most graph properties can be lost while maintaining the monoidal structure of cycles and thus cannot be inferred from it, including vertex transitivity, regularity, planarity, Hamiltonicity, graph spectra, degree distribution and more. Conversely we find that even allowing for multidigraphs, many arrangements of simple cycles are not possible at all. The problem of determining whether a certain arrangement of simple cycles is realizable is highly non trivial. We show at least that it is decidable and equivalent to the existence of integer solutions to systems of polynomial equations.


Federated Learning with Domain Generalization. Federated Learning (FL) enables a group of clients to jointly train a machine learning model with the help of a centralized server. Clients do not need to submit their local data to the server during training, and hence the local training data of clients is protected. In FL, distributed clients collect their local data independently, so the dataset of each client may naturally form a distinct source domain. In practice, the model trained over multiple source domains may have poor generalization performance on unseen target domains. To address this issue, we propose FedADG to equip federated learning with domain generalization capability. FedADG employs the federated adversarial learning approach to measure and align the distributions among different source domains via matching each distribution to a reference distribution. The reference distribution is adaptively generated (by accommodating all source domains) to minimize the domain shift distance during alignment. In FedADG, the alignment is fine grained since each class is aligned independently. In this way, the learned feature representation is supposed to be universal, so it can generalize well on the unseen domains. Extensive experiments on various datasets demonstrate that FedADG has better performance than most of the previous solutions even if they have an additional advantage that allows centralized data access. To support study reproducibility, the project codes are available in https github.com wzml FedADG


Unsupervised Domain Generalization by Learning a Bridge Across Domains. The ability to generalize learned representations across significantly different visual domains, such as between real photos, clipart, paintings, and sketches, is a fundamental capacity of the human visual system. In this paper, different from most cross domain works that utilize some (or full) source domain supervision, we approach a relatively new and very practical Unsupervised Domain Generalization (UDG) setup of having no training supervision in neither source nor target domains. Our approach is based on self supervised learning of a Bridge Across Domains (BrAD) an auxiliary bridge domain accompanied by a set of semantics preserving visual (image to image) mappings to BrAD from each of the training domains. The BrAD and mappings to it are learned jointly (end to end) with a contrastive self supervised representation model that semantically aligns each of the domains to its BrAD projection, and hence implicitly drives all the domains (seen or unseen) to semantically align to each other. In this work, we show how using an edge regularized BrAD our approach achieves significant gains across multiple benchmarks and a range of tasks, including UDG, Few shot UDA, and unsupervised generalization across multi domain datasets (including generalization to unseen domains and classes).


Finite irreducible conformal modules of rank two Lie conformal algebras. In the present paper, we prove that any finite non trivial irreducible module over a rank two Lie conformal algebra mathcal H is of rank one. We also describe the actions of mathcal H on its finite irreducible modules explicitly. Moreover, we show that all finite non trivial irreducible modules of finite Lie conformal algebras whose semisimple quotient is the Virasoro Lie conformal algebra are of rank one.


The Leidenfrost effect as a directed percolation phase transition. Volatile drops deposited on a hot solid can levitate on a cushion of their own vapor, without contacting the surface. We propose to understand the onset of this so called Leidenfrost effect through an analogy to non equilibrium systems exhibiting a directed percolation phase transition. When performing impacts on superheated solids, we observe a regime of spatiotemporal intermittency in which localized wet patches coexist with dry regions on the substrate. We report a critical surface temperature, which marks the upper bound of a large range of temperatures in which levitation and contact coexist. In this range, with decreasing temperature, the equilibrium wet fraction increases continuously from zero to one. Also, the statistical properties of the spatio temporally intermittent regime are in agreement with that of the directed percolation universality class. This analogy allows us to redefine the Leidenfrost temperature and shed light on the physical mechanisms governing the transition to the Leidenfrost state.


Document level Event Extraction via Heterogeneous Graph based Interaction Model with a Tracker. Document level event extraction aims to recognize event information from a whole piece of article. Existing methods are not effective due to two challenges of this task a) the target event arguments are scattered across sentences b) the correlation among events in a document is non trivial to model. In this paper, we propose Heterogeneous Graph based Interaction Model with a Tracker (GIT) to solve the aforementioned two challenges. For the first challenge, GIT constructs a heterogeneous graph interaction network to capture global interactions among different sentences and entity mentions. For the second, GIT introduces a Tracker module to track the extracted events and hence capture the interdependency among the events. Experiments on a large scale dataset (Zheng et al., 2019) show GIT outperforms the previous methods by 2.8 F1. Further analysis reveals GIT is effective in extracting multiple correlated events and event arguments that scatter across the document. Our code is available at https github.com RunxinXu GIT.


Semantically Conditioned Negative Samples for Efficient Contrastive Learning. Negative sampling is a limiting factor w.r.t. the generalization of metric learned neural networks. We show that uniform negative sampling provides little information about the class boundaries and thus propose three novel techniques for efficient negative sampling drawing negative samples from (1) the top k most semantically similar classes, (2) the top k most semantically similar samples and (3) interpolating between contrastive latent representations to create pseudo negatives. Our experiments on CIFAR 10, CIFAR 100 and Tiny ImageNet 200 show that our proposed textit Semantically Conditioned Negative Sampling and Latent Mixup lead to consistent performance improvements. In the standard supervised learning setting, on average we increase test accuracy by 1.52 percentage points on CIFAR 10 across various network architectures. In the knowledge distillation setting, (1) the performance of student networks increase by 4.56 percentage points on Tiny ImageNet 200 and 3.29 on CIFAR 100 over student networks trained with no teacher and (2) 1.23 and 1.72 respectively over a textit hard to beat baseline (Hinton et al., 2015).


A nonabelian Brunn Minkowski inequality. Henstock and Macbeath asked in 1953 whether the Brunn Minkowski inequality can be generalized to nonabelian locally compact groups questions in the same line were also asked by Hrushovski, McCrudden, and Tao. We obtain here such an inequality and prove that it is sharp for helix free locally compact groups, which includes real linear algebraic groups, Nash groups, semisimple Lie groups with finite center, solvable Lie groups, etc. The proof follows an induction on dimension strategy new ingredients include an understanding of the role played by maximal compact subgroups of Lie groups, a necessary modified form of the inequality which is also applicable to nonunimodular locally compact groups, and a proportionated averaging trick.


RoBIC A benchmark suite for assessing classifiers robustness. Many defenses have emerged with the development of adversarial attacks. Models must be objectively evaluated accordingly. This paper systematically tackles this concern by proposing a new parameter free benchmark we coin RoBIC. RoBIC fairly evaluates the robustness of image classifiers using a new half distortion measure. It gauges the robustness of the network against white and black box attacks, independently of its accuracy. RoBIC is faster than the other available benchmarks. We present the significant differences in the robustness of 16 recent models as assessed by RoBIC.


Classical and adelic Eisenstein series. We carry out "Hecke summation" for the classical Eisenstein series E k in an adelic setting. The connection between classical and adelic functions is made by explicit calculations of local and global intertwining operators and Whittaker functions. In the process we determine the automorphic representations generated by the E k , in particular for k 2 , where the representation is neither a pure tensor nor has finite length. We also consider Eisenstein series of weight 2 with level, and Eisenstein series with character.


Morrey's conjecture for the planar volumetric isochoric split. Part I least convex energy functions. We consider Morrey's open question whether rank one convexity already implies quasiconvexity in the planar case. For some specific families of energies, there are precise conditions known under which rank one convexity even implies polyconvexity. We will extend some of these findings to the more general family of energies W operatorname GL (n) rightarrow mathbb R with an additive volumetric isochoric split, i.e. W(F) W rm iso (F) W rm vol ( det F) widetilde W rm iso bigg( frac F sqrt det F bigg) W rm vol ( det F) ,, which is the natural finite extension of isotropic linear elasticity. Our approach is based on a condition for rank one convexity which was recently derived from the classical two dimensional criterion by Knowles and Sternberg and consists of a family of one dimensional coupled differential inequalities. We identify a number of enquote least rank one convex energies and, in particular, show that for planar volumetric isochorically split energies with a concave volumetric part, the question of whether rank one convexity implies quasiconvexity can be reduced to the open question of whether the rank one convex energy function W rm magic (F) frac lambda rm max lambda rm min log frac lambda rm max lambda rm min log det F frac lambda rm max lambda rm min 2 log lambda rm min is quasiconvex. In addition, we demonstrate that under affine boundary conditions, W rm magic (F) allows for non trivial inhomogeneous deformations with the same energy level as the homogeneous solution, and show a surprising connection to the work of Burkholder and Iwaniec in the field of complex analysis.


Less is More Sparse Sampling for Dense Reaction Predictions. Obtaining viewer responses from videos can be useful for creators and streaming platforms to analyze the video performance and improve the future user experience. In this report, we present our method for 2021 Evoked Expression from Videos Challenge. In particular, our model utilizes both audio and image modalities as inputs to predict emotion changes of viewers. To model long range emotion changes, we use a GRU based model to predict one sparse signal with 1Hz. We observe that the emotion changes are smooth. Therefore, the final dense prediction is obtained via linear interpolating the signal, which is robust to the prediction fluctuation. Albeit simple, the proposed method has achieved pearson's correlation score of 0.04430 on the final private test set.


Discrete analog of the Jacobi set for vector fields. The Jacobi set is a useful descriptor of mutual behavior of functions defined on a common domain. We introduce the piecewise linear Jacobi set for general vector fields on simplicial complexes. This definition generalizes the definition of the Jacobi set for gradients of functions introduced by Edelsbrunner and Harer.


Privacy Preserving Infection Exposure Notification without Trust in Third Parties. In response to the COVID 19 pandemic, Bluetooth based contact tracing has been deployed in many countries with the help of the developers of smartphone operating systems that provide APIs for privacy preserving exposure notification. However, it has been assumed by the design that the OS developers, smartphone vendors, or governments will not violate people's privacy. We propose a privacy preserving exposure notification under situations where none of the middle entities can be trusted. We believe that it can be achieved with small changes to the existing mechanism random numbers are generated on the application side instead of the OS, and the positive test results are reported to a public ledger (e.g. blockchain) rather than to a government server, with endorsements from the medical institutes with blind signatures. We also discuss how to incentivize the peer to peer maintenance of the public ledger if it should be newly built. We show that the level of verifiability is much higher with our proposed design if a consumer group were to verify the privacy protections of the deployed systems. We believe that this will allow for safer contact tracing, and contribute to healthier lifestyles for citizens who may want to or have to go out under pandemic situations.


High sensitivity electrochemical dual QCM for reliable three electrode measurements. Electrochemical quartz crystal microbalance (EC QCM) is a versatile gravimetric technique that allows for parallel characterization of mass deposition and electrochemical properties. Despite its broad applicability, simultaneous characterization of two electrodes remains challenging due to practical difficulties posed by the dampening from fixture parasitics and the dissipative medium. In this study, we present a dual electrochemical QCM (dual EC QCM) that is employed in a three electrode configuration to enable consequent monitoring of mass deposition and viscous loading on two crystals, the working electrode (WE) and the counter electrode (CE). A novel cor rection approach along with a three standard complex impedance calibration is employed to overcome the effect of dampening while keeping high spectral sensitivity. Separation of viscous loading and rigid mass deposition is achieved by robust characterization of the complex impedance at the resonance frequency. Validation of the presented system is done by cyclic voltammetry characterization of Ag underpotential deposition on gold. The results indicate mass deposition of 412.2 ng for the WE and 345.6 ng for the CE, reflecting a difference of the initially present Ag adhered to the surface. We also performed higher harmonic measurements that further corroborate the sensitivity and reproducibility of the dual EC QCM. The demonstrated approach is especially intriguing for electrochemical energy storage applications where mass detection with multiple electrodes is desired.


A cell centered Lagrangian ADER MOOD finite volume scheme on unstructured meshes for a class of hyper elasticity models. In this paper we present a conservative cell centered Lagrangian finite volume scheme for the solution of the hyper elasticity equations on unstructured multidimensional grids. The starting point of the new method is the Eucclhyd scheme, which is here combined with the a posteriori Multidimensional Optimal Order Detection (MOOD) limiting strategy to ensure robustness and stability at shock waves with piece wise linear spatial reconstruction. The ADER (Arbitrary high order schemes using DERivatives) approach is adopted to obtain second order of accuracy in time as well. This method has been tested in an hydrodynamics context and the present work aims at extending it to the case of hyper elasticity models. Such models are presented in a fully Lagrangian framework and the dedicated Lagrangian numerical scheme is derived in terms of nodal solver, GCL compliance, subcell forces and compatible discretization. The Lagrangian numerical method is implemented in 3D under MPI parallelization framework allowing to handle genuinely large meshes. A relative large set of numerical test cases is presented to assess the ability of the method to achieve effective second order of accuracy on smooth flows, maintaining an essentially non oscillatory behavior and general robustness across discontinuities and ensuring at least physical admissibility of the solution where appropriate. Pure elastic neo Hookean and non linear materials are considered for our benchmark test problems in 2D and 3D. These test cases feature material bending, impact, compression, non linear deformation and further bouncing detaching motions.


Numerical Performance of Different Formulations for Alternating Current Optimal Power Flow. Alternating current optimal power flow (ACOPF) problems are nonconvex and nonlinear optimization problems. Utilities and independent service operators (ISO) require ACOPF to be solved in almost real time. Interior point methods (IPMs) are one of the powerful methods for solving large scale nonlinear optimization problems and are a suitable approach for solving ACOPF with large scale real world transmission networks. Moreover, the choice of the formulation is as important as choosing the algorithm for solving an ACOPF problem. In this paper, different ACOPF formulations with various linear solvers and the impact of employing box constraints are evaluated for computational viability and best performance when using IPMs. Different optimization structures are used in these formulations to model the ACOPF problem representing a range of sparsity. The numerical experiments suggest that the least sparse ACOPF formulations with polar voltages yield the best computational results. Additionally, nodal injected models and current based branch flow models are improved by enforcing box constraints. A wide range of test cases, ranging from 500 bus systems to 9591 bus systems, are used to verify the test results.


Quantised Transforming Auto Encoders Achieving Equivariance to Arbitrary Transformations in Deep Networks. In this work we investigate how to achieve equivariance to input transformations in deep networks, purely from data, without being given a model of those transformations. Convolutional Neural Networks (CNNs), for example, are equivariant to image translation, a transformation that can be easily modelled (by shifting the pixels vertically or horizontally). Other transformations, such as out of plane rotations, do not admit a simple analytic model. We propose an auto encoder architecture whose embedding obeys an arbitrary set of equivariance relations simultaneously, such as translation, rotation, colour changes, and many others. This means that it can take an input image, and produce versions transformed by a given amount that were not observed before (e.g. a different point of view of the same object, or a colour variation). Despite extending to many (even non geometric) transformations, our model reduces exactly to a CNN in the special case of translation equivariance. Equivariances are important for the interpretability and robustness of deep networks, and we demonstrate results of successful re rendering of transformed versions of input images on several synthetic and real datasets, as well as results on object pose estimation.


The Mabuchi geometry of low energy classes. Let (X, omega) be a K "ahler manifold and psi Bbb R to Bbb R be a concave weight. We show that mathcal H omega admits a natural metric d psi whose completion is the low energy space mathcal E psi , introduced by Guedj Zeriahi. As d psi is not induced by a Finsler metric, the main difficulty is to show that the triangle inequality holds. We study properties of the resulting complete metric space ( mathcal E psi,d psi) .


Weierstrass semigroup at m 1 rational points in maximal curves which cannot be covered by the Hermitian curve. We determine the Weierstrass semigroup H(P infty,P 1, ldots,P m) at several rational points on the maximal curves which cannot be covered by the Hermitian curve introduced by Tafazolian, Teher 'an Herrera, and Torres. Furthermore, we present some conditions to find pure gaps. We use this semigroup to obtain AG codes with better relative parameters than comparable one point AG codes arising from these curves.


Cloud Versus Local Processing in Distributed Networks. A method for evaluating the relative performance of local, cloud and combined processing of divisible (i.e. partitionable) data loads is presented. It is shown how to do this in the context of Amdahl's law. A single level (star) network operating under each of three fundamental scheduling policies is used as an example. Applications include mobile computing, cloud computing and signature searching.


SMPSO Revisited A Theoretical Analysis of Exponentially Averaged Momentum in Multi Objective Problems. It has been well documented that the use of exponentially averaged momentum (EM) in particle swarm optimization (PSO) is advantageous over the vanilla PSO algorithm. In the single objective setting, it leads to faster convergence and avoidance of local minima. Naturally, one would expect that the same advantages of EM carry over to the multi objective setting. Hence, we extend the state of the art Multi objective optimization (MOO) solver, SMPSO, by incorporating EM in it. As a consequence, we develop the mathematical formalism of constriction fairness which is at the core of extended SMPSO algorithm. The proposed solver matches the performance of SMPSO across the ZDT, DTLZ and WFG problem suites and even outperforms it in certain instances.


Unassisted Noise Reduction of Chemical Reaction Data Sets. Existing deep learning models applied to reaction prediction in organic chemistry can reach high levels of accuracy ( 90 for Natural Language Processing based ones). With no chemical knowledge embedded than the information learnt from reaction data, the quality of the data sets plays a crucial role in the performance of the prediction models. While human curation is prohibitively expensive, the need for unaided approaches to remove chemically incorrect entries from existing data sets is essential to improve artificial intelligence models' performance in synthetic chemistry tasks. Here we propose a machine learning based, unassisted approach to remove chemically wrong entries from chemical reaction collections. We applied this method to the collection of chemical reactions Pistachio and to an open data set, both extracted from USPTO (United States Patent Office) patents. Our results show an improved prediction quality for models trained on the cleaned and balanced data sets. For the retrosynthetic models, the round trip accuracy metric grows by 13 percentage points and the value of the cumulative Jensen Shannon divergence decreases by 30 compared to its original record. The coverage remains high with 97 , and the value of the class diversity is not affected by the cleaning. The proposed strategy is the first unassisted rule free technique to address automatic noise reduction in chemical data sets.


Viscosity solutions to complex first eigenvalue equations. We study the viscosity solutions to the first eigenvalue equation. We consider Omega a bounded B regular domain in mathbb C n and we prove that the Dirichlet problem Lambda 1 (D mathbb C 2 u) f in Omega and u varphi on partial Omega admits a unique viscosity solution. We also deal with viscosity theory for operators which are comparable to the first eigenvalue operator.


An acceleration strategy for randomize then optimize sampling via deep neural networks. Randomize then optimize (RTO) is widely used for sampling from posterior distributions in Bayesian inverse problems. However, RTO may be computationally intensive for complexity problems due to repetitive evaluations of the expensive forward model and its gradient. In this work, we present a novel strategy to substantially reduce the computation burden of RTO by using a goal oriented deep neural networks (DNN) surrogate approach. In particular, the training points for the DNN surrogate are drawn from a local approximated posterior distribution, and it is shown that the resulting algorithm can provide a flexible and efficient sampling algorithm, which converges to the direct RTO approach. We present a Bayesian inverse problem governed by a benchmark elliptic PDE to demonstrate the computational accuracy and efficiency of our new algorithm (i.e., DNN RTO). It is shown that with our algorithm, one can significantly outperform the traditional RTO.


Learn Dynamic Aware State Embedding for Transfer Learning. Transfer reinforcement learning aims to improve the sample efficiency of solving unseen new tasks by leveraging experiences obtained from previous tasks. We consider the setting where all tasks (MDPs) share the same environment dynamic except reward function. In this setting, the MDP dynamic is a good knowledge to transfer, which can be inferred by uniformly random policy. However, trajectories generated by uniform random policy are not useful for policy improvement, which impairs the sample efficiency severely. Instead, we observe that the binary MDP dynamic can be inferred from trajectories of any policy which avoids the need of uniform random policy. As the binary MDP dynamic contains the state structure shared over all tasks we believe it is suitable to transfer. Built on this observation, we introduce a method to infer the binary MDP dynamic on line and at the same time utilize it to guide state embedding learning, which is then transferred to new tasks. We keep state embedding learning and policy learning separately. As a result, the learned state embedding is task and policy agnostic which makes it ideal for transfer learning. In addition, to facilitate the exploration over the state space, we propose a novel intrinsic reward based on the inferred binary MDP dynamic. Our method can be used out of box in combination with model free RL algorithms. We show two instances on the basis of algo DQN and algo A2C . Empirical results of intensive experiments show the advantage of our proposed method in various transfer learning tasks.